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Abstract 

Optimal  design  techniques  have  proven  to  be  an  effective  systems  engineering  tool. 

Using  systems  architecture  as  the  foundation,  this  research  explores  the  use  of  mixed 
variable  optimization  models  for  synthesizing  and  evaluating  disaggregated  space  system 
concepts.  Model-based  conceptual  design  techniques  are  used  to  identify  and  assess 
system  architectures  based  upon  estimated  system  cost,  performance  trades,  and  cost  risk. 
The  Disaggregated  Integral  System  Concept  Optimization  (DISCO)  methodology  is 
introduced,  and  then  applied  to  representative  space-based  missions.  Several  results  are 
obtained  that  indicate  significant  cost  effectiveness  gains  from  the  optimization  of  multi¬ 
orbit  and  multi-function/multi-orbit  disaggregated  space  systems.  Savings  of  $82  million 
are  identified  for  an  optimized  fire  detection  system.  Savings  of  $5.7  billion  are 
identified  for  an  optimized  defense  weather  system.  This  optimized  defense  weather 
system  was  also  shown  to  have  a  reduction  in  cost  risk  due  to  failures  of  $  1 17  million. 
The  general  methodology  has  broad  applicability  for  model-based  conceptual  design 
(MBCD)  of  many  system  types,  but  is  particularly  useful  for  dynamic  disaggregated 
space  systems. 
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A  METHODOLOGY  FOR  THE  OPTIMIZATION  OF  DISAGGREGATED 
SPACE  SYSTEM  CONCEPTUAL  DESIGNS 

I.  Introduction 

Space  system  architectures  based  upon  large,  complex,  aggregated  satellites  are 
costly,  lack  resilience,  and  are  susceptible  to  catastrophic  failure  risks.  Disaggregated 
space  system  architectures  are  a  proposed  solution  to  reduce  space  system  costs,  increase 
resiliency,  and  reduce  the  risk  posture  of  critical  defense  related  space  systems.  Further 
analysis  is  necessary  to  determine  whether  these  potential  benefits  are  obtainable. 

Current  methods  of  space  system  conceptual  architecting  are  largely  based  upon  the 
design,  assessment,  and  improvement  of  a  few  candidate  architectures.  These  current 
methods  are  inadequate  to  effectively  design,  assess,  and  optimize  the  vast  conceptual 
design  space  associated  with  these  types  of  systems.  A  research  methodology  is  desired 
that  improves  upon  the  state  of  the  art  in  computer  automated  design,  assessment,  and 
optimization  of  complex  disaggregated  space  system  architectures.  The  developed 
methodology  is  tenned  Disaggregated  Integral  System  Component  Optimization 
(DISCO).  This  methodology  is  applied  to  a  basic  space-based  fire  detection  problem, 
and  then  a  realistic  spaced-based  weather  mission.  Significant  contributions  are  made  in 
space  system  modeling,  optimization,  and  analysis  methods.  The  application  results  also 
hold  significant  promise  as  conceptual  designs  capable  of  addressing  critical  needs  in  a 
cost  effective  and  low  risk  manner. 

Problem 

The  general  problem  is  space  systems  designed  using  traditional  methods  are 
experiencing  exponential  cost  and  complexity  growth  while  budgets  for  developing  and 
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producing  these  space  systems  are  increasingly  more  constrained.  An  example  of  how 
incremental  improvements  in  functionality  have  caused  exponential  increases  in  satellite 
mass  and  program  life  cycle  cost  is  shown  in  Figure  1.  This  exponential  space  vehicle 
mass  and  program  life  cycle  cost  growth  will  lead  to  significant  affordability  and 
resilience  problem  for  the  U.S.  Department  of  Defense  (DOD).  Optimization  of 
disaggregated  space  systems  is  a  potential  solution  to  this  growing  problem,  however, 
new  methods  are  required  to  design  disaggregated  space  systems. 
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Figure  1.  Exponential  Space  System  Life  Cycle  Cost  (LCC)  Growth  Example 


Research  Objectives 

The  overall  objective  of  the  proposed  research  is  the  development  of  an  effective 
methodology  capable  of  automated  generation,  evaluation,  and  optimization  of  novel 
disaggregated  space  system  architectures.  There  are  four  corollary  sub-objectives  to  meet 
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this  overall  objective.  The  first  sub-objective  is  to  develop  methods  capable  of 
quantifying  the  impact  of  the  disaggregation  strategy.  The  second  sub-objective  is  to 
develop  methods  capable  of  optimizing  concept  designs  for  various  disaggregation 
approaches  (multi-orbit,  multi-function).  The  third  sub-objective  is  to  develop  methods 
that  are  capable  of  effectively  identifying  and  analyzing  the  significant  trades  associated 
with  lifecycle  costs  and  system  performance  for  disaggregated  space  system  conceptual 
architectures.  The  fourth  sub-objective  is  to  develop  methods  capable  of  assessing  the 
impacts  of  stochastic  variables  on  disaggregated  space  system  architectures.  A  verified 
automated  capability  to  design,  assess,  and  optimize  disaggregated  space-system 
architectures  in  a  quantifiable  manner  that  addresses  significant  trades,  competing 
disaggregation  strategies,  and  impacts  of  stochastic  variables  would  represent  a 
significant  advancement  in  the  general  system  architecting  practice.  It  would  especially 
make  a  significant  impact  in  the  space  architecting  and  policy  community  that  is 
currently  struggling  to  find  and  justify  strategies  that  would  increase  the  resiliency  and 
responsiveness  of  space  systems  in  a  budget  constrained  environment. 

Research  Questions/Hypotheses 

The  primary  research  question  addressed  in  this  dissertation  is:  What  is  an 
effective  methodology  for  the  conceptual  design,  assessment,  and  optimization  of 
disaggregated  space  system  architectures?  Four  corollary  research  questions  necessary  to 
answer  this  primary  research  question  are  identified  as: 

1.  How  does  one  model/optimize  disaggregated  space  system  concepts? 
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2.  How  does  one  model/optimize  multi-orbit/multi-function  disaggregated  space  system 
concepts? 

3.  How  does  one  conduct  trade  studies  and  requirements  sensitivity  analysis  for 
disaggregated  space  system  concepts? 

4.  How  does  one  assess  the  impact  of  stochastic  variables  on  disaggregated  space  system 
architectures? 

Several  hypotheses  were  made  related  to  this  research.  First,  it  was  hypothesized 
that  the  Disaggregated  Integral  System  Concept  Optimization  (DISCO)  methodology 
could  be  demonstrated  as  an  effective  methodology  for  finding  concept  solutions  that 
were  as  cost  effective  as  existing  concepts  developed  through  traditional  architecting 
methods.  Second,  it  was  hypothesized  that  heterogeneous  (mixed)  satellite 
constellations  would  be  identified  as  near-optimal  multi-orbit  disaggregation  solutions. 
Third,  it  was  hypothesized  that  near-optimal  solutions  will  consist  of  heterogeneous 
constellations  when  multi-function  and  stochastic  parameters  are  taken  into  account. 
Finally,  it  was  hypothesized  that  disaggregated  space  systems  would  have  less  cost  risk 
due  to  failures. 

Methodology  Overview 

The  Disaggregated  Integral  System  Concept  Optimization  (DISCO)  methodology 
was  developed  to  provide  an  analysis  capability  needed  to  solve  complex  disaggregated 
space  system  concept  optimization  problems.  An  overview  of  the  DISCO  methodology 
is  shown  in  Figure  2.  The  methodology  consists  of  four  model  components  (system 
architecture,  system  dynamics,  system  performance,  and  system  optimization).  A 
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reference  system  architecture  model  is  developed.  This  reference  system  architecture 
forms  the  basis  for  an  integrated  optimization,  dynamics,  and  performance  model  that  is 
used  to  identify  near  optimal  solutions.  Of  note,  the  architecture  uses  Systems  Modeling 
Language  (SysML)  descriptions  to  document  realizable  and  parameterized  system  types. 
The  solutions  are  then  analyzed  and  used  to  update  the  system  reference  architecture. 

The  methods  used  to  develop  the  reference  architecture  and  maintain  concordance 
between  the  models  are  discussed  in  more  detail  in  Appendix  B.  Further  details  on  these 
components  and  how  they  are  developed  are  discussed  in  chapters  II  -  IV. 


Figure  2.  DISCO  methodology  overview 


The  details  of  the  DISCO  iterations  are  presented  in  Figure  3.  The  DISCO 
process  consists  of  a  Genetic  Algorithm  (GA)  routine  that  searches  over  many 
generations  to  find  candidate  solutions.  The  GA  is  executed  via  multiple  iterations  to 
increase  confidence  in  the  local  optimal  solutions.  Stochastic  parameters  are  then 
updated  via  a  Monte  Carlo  routine  to  detennine  the  impact  of  randomized  model 
parameter  (if  applicable).  Finally,  a  sensitivity  analysis  is  conducted  by  executing 
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multiple  cases  with  updated  model  parameters  associated  with  system  requirements. 
Further  details  on  the  application  of  the  DISCO  process  are  discussed  in  Chapters  II-IV. 


■Case  =  Case  +  1 


Figure  3.  DISCO  process 


The  DISCO  methodology  represents  a  significant  evolution  in  space  system 
optimization  methods.  A  literature  review  summarizing  extant  methods  is  provided  in 
Appendix  A.  Relevant  research  and  significant  methodology  variations  are  also 
highlighted  in  chapters  II-IV  as  applicable.  The  DISCO  methodology  enables  the 
optimization  of  heterogeneous  system  types,  system  parameter  optimization,  optimized 
system  requirement  trades,  and  stochastic  analysis  in  an  integrated  methodology.  The 
utility  of  these  advancements  and  the  limitation  of  previous  space  system  optimization 
methodologies  are  discussed  in  Chapters  II-IV. 

Assumptions/Limitations 

Assumptions  made  in  this  research  relate  to  model  fidelity,  system  scaling,  and 
orbital  parameters.  The  research  conducted  assumes  that  existing  cost  and  perfonnance 
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models  are  sufficiently  accurate  for  system  concept  design.  Cost  models  such  as  the 
Unmanned  Space  Vehicle  Cost  Model  (USCM),  the  Small  Satellite  Cost  Model  (SSCM), 
the  NASA  Instrument  Cost  Model  (NICM),  and  the  NASA  Operations  Cost  Model 
(NOCM)  were  used  without  modification.  The  accuracy  of  cost  estimates  utilized  in  this 
research  is  dependent  upon  the  fidelity  of  these  pedigreed  cost  models.  Cost  estimates 
were  compared  with  analogous  systems  whenever  possible  to  verify  the  applicability  of 
the  models.  The  DISCO  methodology  assumes  that  system  parameters  are  sufficiently 
estimated  using  parametric  sizing  relationships.  Space  vehicle  and  payload  parameters 
such  as  mass,  weight,  and  power  are  scaled  using  analogous  components  according  to 
parametric  relationships  outlined  in  chapter  14  and  17  of  [1].  These  sizing  relationships 
are  inexact  but  necessary  for  the  DISCO  methodology.  Scaling  results  were  compared  to 
multiple  analogous  systems  when  available  and  margin  was  applied  to  minimize  the 
impact  of  scaling  estimate  inaccuracies.  Orbits  used  in  this  analysis  are  assumed  to  be 
circular  and  orbital  perturbations  are  assumed  to  have  a  minimal  impact  on  coverage  and 
revisit  requirements.  Circular  orbits  enable  assessment  due  to  predictable  ground  tracks 
and  orbital  perturbations  have  a  minimal  impact  over  the  relatively  short  analysis  time 
periods  used.  Consequently  it  is  assumed  that  the  space  vehicles  used  will  have  a 
capability  to  maintain  a  near  circular  orbit  and  desired  constellation  phasing.  These 
assumptions  are  consistent  with  those  found  in  the  researched  literature  and  are  likely 
appropriate  for  early  conceptual  designs. 

The  research  methods  discussed  are  currently  limited  to  the  space  systems 
engineering  domain  and  Walker  satellite  constellations  [2].  The  DISCO  methodology 
could  be  extended  beyond  space  systems;  however  the  current  formulations  are  only 
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directly  applicable  to  earth  orbiting  space  system  concept  design  problems.  The  DISCO 
methodology  requires  that  the  perfonnance  of  the  disaggregated  system  can  be  accurately 
estimated  using  physics-based  models.  An  extension  to  manned  or  remotely  piloted 
vehicles  could  be  accomplished,  but  would  be  difficult  due  to  the  effects  of  operator 
proficiency  and  perfonnance.  The  methods  are  also  currently  limited  to  Walker  satellite 
constellations  based  upon  the  number  of  evenly  spaced  satellite  planes  and  satellites  per 
plane.  These  limitations  do  not  appreciably  reduce  the  significance  of  the  research  as  the 
methodology  is  still  applicable  to  many  real  world  conceptual  design  problems. 

Implications 

A  vision  for  disaggregated  space  systems  was  presented  in  [3]  identifying 
disaggregation  as  a  promising  new  strategy  to  address  disruptive  challenges  related  space 
systems.  The  research  summarized  in  this  dissertation  has  significant  implications  related 
to  the  validation  and  eventual  achievement  of  this  vision.  Achievement  of  this  vision  has 
far  reaching  impacts  related  to  the  reduction  of  space  system  life  cycle  costs,  increased 
space  system  resiliency,  reduced  development  and  production  timelines,  improved  space 
systems  engineering  education  and  knowledge  base,  a  stabilized  industrial  base,  and  an 
improved  competitive  environment. 

This  research  has  the  potential  to  significantly  reduce  space  system  life  cycle 
costs.  The  DISCO  methodology  is  broadly  applicable  to  numerous  space  system 
applications  including  weather,  global  precision  navigation  and  timing,  imagery, 
communications,  missile  warning,  missile  defense,  and  space  situational  awareness.  Cost 
effectiveness  gains  identified  through  the  DISCO  methodology  have  the  potential  to 
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dramatically  reduce  the  cost  of  developing  and  producing  the  systems  associated  with 
these  mission  areas.  The  combined  cost  of  these  space  systems  represents  a  significant 
fraction  of  the  DoD  budget.  Consequently,  cost  effectiveness  gains  in  these  space 
systems  have  the  potential  to  enable  the  acquisition  community  to  close  budget  gaps  in  a 
fiscally  constrained  environment. 

This  research  has  the  potential  to  significantly  improve  space  system  resiliency. 
Space  system  architectures  consisting  of  a  few  highly  capable  space  vehicles  are 
vulnerable  to  catastrophic  failures  and  are  relatively  easy  targets.  Space  system 
architectures  consisting  of  a  multitude  of  distributed  small  satellites  reduce  these 
vulnerabilities  and  significantly  change  the  targeting  calculus.  Optimizing  space  system 
designs  to  minimize  risk  weighted  cost  enables  system  architects  to  trade  system 
capability  and  system  risk. 

This  research  has  the  potential  to  significantly  reduce  space  system  development 
and  production  timelines.  Large  aggregated  satellite  development,  production,  and 
deployment  timelines  are  highly  dependent  upon  parallel  timelines.  If  delays  occur  in  the 
development  or  production  of  a  single  component  or  payload  then  the  entire  timeline  is 
impacted.  Disaggregated  space  system  architectures  reduce  these  critical  path  linkages 
and  enable  the  deployment  of  capabilities  in  a  shortened  timeline. 

This  research  has  the  potential  to  improve  space  systems  engineering  education 
and  increase  the  space  systems  knowledge  of  body.  Current  space  systems  engineering 
courses  reinforce  systems  engineering  methods  that  identify  a  small  number  of  feasible 
alternatives.  Significant  effort  is  spent  manually  developing  alternative  concepts, 
conducting  subsystem  trades,  and  calculating  results  for  each  potential  solution.  The 
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methods  identified  by  this  research  enable  the  automated  generation,  assessment,  and 
optimization  of  vast  numbers  of  conceptual  design.  This  automated  process  thus  enables 
students  to  focus  their  efforts  on  system  level  trades  and  more  detailed  design  aspects. 
Concepts  with  smaller  less  complex  satellites  also  increase  opportunities  for  students  to 
get  hands-on  development  experience  with  flight  hardware.  This  hands-on  experience 
developing  space  systems  increases  student  learning  as  demonstrated  by  the  multitude  of 
university  cubesat  programs. 

Disaggregated  space  system  research  has  the  potential  to  stabilize  the  space 
system  industrial  base  and  improve  the  competitive  environment.  Disaggregated  space 
systems  have  the  potential  to  “stabilize  lower-tier  suppliers  through  stable  production  and 
launch”  [3].  Space  system  concepts  based  upon  large  aggregated  satellites  tend  to  create 
programs  that  are  so  large  and  complex  that  only  a  few  industrial  developers  are  capable 
of  system  development  and  production.  Disaggregated  systems  have  the  potential  to 
expand  the  competitive  base  to  include  a  greater  number  of  potential  developers. 

Preview 

This  dissertation  is  organized  according  to  the  scholarly  article  format.  Chapters 
II  through  IV  are  drawn  from  manuscripts  published  or  in  review  with  predominant  space 
systems  or  systems  engineering  journals.  Chapter  II,  titled  “Methodology  Development 
and  Introduction”  addresses  research  question  #1  identified  above.  This  chapter  is  drawn 
from  a  manuscript  titled  Disaggregated  Space  System  Concept  Optimization:  Model 
Based  Conceptual  Design  Methods  that  has  been  accepted  for  publication  in  Systems 
Engineering,  the  journal  of  the  International  Council  on  Systems  Engineering.  Chapter  II 
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introduces  the  DISCO  methodology  and  demonstrates  utility  by  optimizing  a  notional  fire 
detection  system.  Chapter  III,  titled  “Multi-function  Optimization  and  Sensitivity 
Analysis  Methods”  addresses  research  question  #2  and  #3  identified  above.  This  chapter 
is  drawn  from  a  manuscript  titled  Model-Based  Conceptual  Design  Optimization 
Methods:  Disaggregated  Weather  System  Follow-on  that  has  been  accepted  for 
publication  in  the  American  Institute  of  Aeronautics  and  Astronautics  (AIAA)  Journal  of 
Spacecraft  and  Rockets.  Chapter  III  expands  the  DISCO  methodology  enabling  multi¬ 
function  optimization  using  a  realistic  Weather  System  Follow-on  (WSF)  problem  as  an 
example  application.  Chapter  III  also  demonstrates  how  a  sensitivity  analysis  can  be 
perfonned  by  changing  critical  system  requirements  (modeled  as  constraints)  such  as 
required  average  revisit  time.  Chapter  IV,  titled  “Stochastic  Analysis  Methods” 
addresses  research  question  #4.  The  text  is  drawn  from  a  manuscript  titled 
Disaggregated  Space  System  Concept  Optimization:  Stochastic  Analysis  Methods  that 
has  been  submitted  to  the  Institute  of  Electrical  and  Electronics  Engineers  (IEEE) 
Transaction  on  Aerospace  and  Electronic  Systems  Journal.  The  manuscript  is  currently  in 
review.  Chapter  IV  finalizes  the  research  by  demonstrating  impact  of  stochastic  launch 
vehicle  and  space  vehicle  failure  rates  on  life  cycle  cost  risk  for  the  WSF  concept. 
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II.  Methodology  Development  and  Introduction 


Introduction 

Today’s  space  systems  have  far  reaching  impacts  to  military,  civilian,  and  commercial 
end-users  globally.  They  provide  a  multitude  of  mission  applications  such  as 
communications;  global  navigation  and  timing;  precise  weather  and  climate  inputs; 
global  intelligence,  surveillance,  and  reconnaissance;  and  a  continuous  record  of  our 
earth’s  surface.  However,  the  systems  that  provide  these  capabilities  can  be  complex, 
costly,  with  high  technical  risks  [4].  It  has  been  hypothesized  that  the  “vicious  circle  of 
space  acquisition”  leads  to  large,  complex,  and  expensive  satellites  that  lack  resiliency. 
Furthennore,  it  has  been  proposed  that  applying  disaggregation  strategies  to  space  system 
conceptual  design  could  improve  cost  effectiveness  and/or  reduce  risk  exposure  to 
catastrophic  failures.  [3] 

Current  methods  of  space  system  conceptual  architecting  are  largely  based  on  the 
design,  assessment,  and  improvement  of  a  few  candidate  architectures.  These  methods 
are  inadequate  to  effectively  design,  assess,  and  optimize  the  vast  conceptual  design 
space  associated  with  disaggregated  space  systems. 

The  vast  trade  space  associated  with  system  architectures  in  the  concept  phase  can  lead  to 
analysis  difficulties.  Simpson  and  Dagli  state  that  when  a  system  under  design  is  “highly 
dynamic  and  contains  a  large  number  of  context-specific,  adaptable  interfaces,  the  task  of 
system  architecting  can  become  overwhelming”  [5],  Disaggregated  space  systems 
represent  highly  dynamic  systems  with  a  large  number  of  context-specific  adaptable 
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interfaces.  Therefore,  particular  attention  should  be  paid  to  developing  methodologies 
that  increase  effectiveness  of  the  conceptual  design  process  if  the  potential  benefits  of 
disaggregated  space  systems  are  to  be  achieved.  To  this  end,  this  paper  introduces  a 
novel  Disaggregated  Integral  System  Concept  Optimization  (DISCO)  methodology  and 
applies  it  to  a  space-based  fire  detection  mission. 

Background 

Disaggregation  Strategies 

Recently,  disaggregation  has  gained  considerable  interest  as  a  system  architecting 
approach  to  improve  the  resiliency  and  robustness  of  space  systems,  as  well  as  increase 
affordability,  technology  refresh  rates,  and  launch  and  space  industrial  base  stability. 
Disaggregation  is  defined  as  “the  dispersion  of  space-based  missions,  functions,  or 
sensors  across  multiple  systems  spanning  one  or  more  orbital  plane,  platform,  host,  or 
domain”  (Air  Force  Space  Command,  2013).  The  potential  improvements  that 
disaggregated  space  systems  have  to  offer  are  highly  dependent  upon  effective 
conceptual  design  and  system  architecting. 

It  has  been  proposed  that  disaggregation  can  be  categorized  into  five  distinct 
architecting  approaches  consisting  of  multi-orbit  disaggregation,  functional 
disaggregation,  hosted  payloads,  fractionation,  and  multi-domain  disaggregation  [6]. 
Some  or  all  of  these  approaches  may  be  appropriate  for  a  particular  conceptual 
architecture  problem. 

Multi-orbit  disaggregation  is  the  dispersion  of  sensors  or  payloads  across  multiple 
satellites  spanning  one  or  more  orbital  planes.  Multi-orbit  disaggregation  is  a  familiar 
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concept  for  space  systems  engineers.  Multi-orbit  disaggregation  is  often  employed  to 
meet  geographic  coverage  or  revisit  requirements.  Satellite  constellations  such  as  the 
Global  Positioning  System  (GPS),  Galileo,  IRIDIUM,  and  the  Defense  Meteorological 
Satellite  Program  (DMSP)  employ  payloads  on  multiple  satellites  in  separate  orbital 
planes  at  the  same  orbital  altitude  to  meet  coverage  requirements.  Weather  satellites  also 
routinely  disperse  sensors  providing  similar  functionality  in  low  earth  orbit  and 
geosynchronous  orbit  to  provide  global  coverage  and  meet  varied  coverage  and  revisit 
rate  requirements.  The  U.S  Air  Force  Space  Command  (AFSPC)  is  currently 
investigating  the  potential  of  replacing  or  augmenting  the  baseline  GPS  constellation  with 
numerous  small  NavSats  [7]. 

Multi-function  disaggregation  is  the  dispersion  of  functions  from  large  multi-function 
satellites  to  smaller  functionally  cohesive  spacecraft.  A  recent  example  of  multi-function 
disaggregation  is  the  Space  Environment  NanoSatellite  Experiment  (SENSE)  program. 
Two  SENSE  satellites  launched  in  November  2013  successfully  demonstrated  the 
dispersion  of  space  weather  functionality  onto  functionally  cohesive  cubesats  [8].  The 
strategic  and  tactical  protected  communications  mission  currently  provided  by  Advanced 
Extremely  High  Frequency  (AEHF)  satellites  are  being  studied  for  functional 
disaggregation  [3], 

Hosted  payload  disaggregation  disperses  sensors  or  payloads  from  large  satellites  onto 
other  defense,  civil,  or  commercial  satellite  systems.  A  recent  example  of  hosted  payload 
disaggregation  is  the  Commercially  Hosted  Infrared  Payload  (CHIRP)  experiment.  The 
dispersion  of  GPS  functionality  onto  Positioning,  Navigation,  &  Timing  (PNT)  hosted 
payloads  to  augment  a  revamped  GPS  constellation  is  being  considered  by  the  Air  Force. 
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Fractionated  space  systems  are  intended  to  disperse  the  subsystem  functionality  of  a 
satellite  among  multiple  satellites.  The  Defense  Advanced  Research  Project  Agency 
(DARPA)  F6  program  was  an  example  of  fractionated  space  system  architecture  [9]. 
Lastly,  multi-domain  disaggregation  is  a  strategy  where  functions  are  dispersed  across 
multiple  domains  such  as  land,  sea,  space,  or  cyber.  The  Air  Force  Space-based  Space 
Surveillance  System  (SBSS)  is  an  example  of  multi-domain  disaggregation. 

Many  practical  concept  trade  studies  may  include  combinations  of  the 
disaggregation  strategies  outlined  above.  For  example  Multi-orbit/Multi-function 
disaggregation  enables  the  dispersion  of  sensors  and  payloads  commonly  aggregated  on 
large  satellites  to  be  sized  and  dispersed  onto  smaller  functionally  cohesive  satellites 
placed  in  orbits  conducive  to  the  mission.  The  design  of  the  Weather  System  Follow-on 
(WSF)  concept  can  be  viewed  as  a  multi-function/multi-orbit  disaggregation  problem. 
Significant  potential  life-cycle  savings  have  been  identified  using  the  DISCO 
methodology  to  assess  the  WSF  conceptual  design  problem  [10].  The  proposed  DISCO 
methodology  enables  the  systematic  analysis  and  comparison  of  these  disaggregation 
concepts. 

Model-Based  Conceptual  Design  (MBCD) 

Model-Based  Systems  Engineering  (MBSE)  is  the  “formalized  application  of 
modeling  to  support  system  requirements,  design,  analysis,  verification  and  validation, 
beginning  in  the  conceptual  design  phase  and  continuing  throughout  development  and 
later  life  cycle  phases”  [11].  The  primary  output  of  MBSE  is  a  coherent  model  of  the 
system  and  emphasis  is  placed  on  evolving  and  refining  the  model  using  model-based 
methods  and  tools  (Friedenthal  et  ah,  2012).  Model-Based  Conceptual  Design  (MBCD) 
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is  “the  application  of  MBSE  to  the  exploratory  research  and  concept  stages  of  the  generic 
lifecycle”  [12].  During  conceptual  design,  it  is  unlikely  that  the  system  architect  has  high 
fidelity  models  for  all  associated  areas.  A  system  architect  is  likely  limited  to  parametric 
cost  models  and  initial  functional  and  perfonnance  models.  Therefore,  the  integration  of 
standardized  systems  engineering  tools  that  are  capable  of  integrating  parametric  cost 
models  with  functional  and  performance  models  could  provide  significant  utility. 

MBCD  processes  and  methodologies  are  still  maturing.  The  DISCO  methodology  is  an 
example  of  applying  MBCD  techniques  to  the  space  system  domain.  In  this  approach, 
stakeholder’s  needs  are  mapped  to  quantitative  measures  of  effectiveness.  Then, 
component  technologies  are  associated  to  potential  system  types.  Stakeholder’s  needs  are 
refined  by  providing  early  conceptual  feedback  of  operational  performance  and 
affordability.  Finally,  feasible  and  potential  near-optimal  solutions  are  identified  and 
analyzed  via  an  integrated  optimization  construct. 

Systems  Architecture 

Systems  architecture  is  the  “selection  of  system  elements,  their  characteristics, 
and  their  arrangement”.  The  arrangement  and  characteristics  of  these  elements  must 
meet  requirements  and  implement  functions  in  a  near-optimal  and  technically  mature  and 
consistent  manner  [13].  The  system  architecture  process  includes  defining  the 
architecture,  analyzing  and  evaluating  the  architecture,  and  documenting  and  maintaining 
the  architecture  [13].  Traditional  system  architecting  is  iterative  and  highly  dependent 
upon  engineering  analysis,  heuristics  and  experience;  consequently,  the  synthesis  of 
multiple  system  architectures  can  be  very  resource  intensive. 
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The  selection  of  a  preferred  system  architecture  solution  is  highly  dependent  upon 
metrics  and  evaluation  criteria.  Automation  of  the  synthesis  and  evaluation  of  alternative 
system  architectures  is  a  primary  goal  of  a  MBCD  methodology.  Significant  academic 
research  has  been  conducted  on  evaluating  and  ranking  architectures  based  upon  expert 
evaluations.  Multi  Attribute  Utility  Theory  is  often  used  to  rank  and  evaluate  alternative 
architectures  [14].  Additionally,  Simpson  and  Dagli  described  the  use  of  genetic 
algorithms  to  conduct  alternative  analysis/evaluation  in  [5].  Their  effort  is  largely 
focused  on  subjective  assessments  of  a  system  and  the  fuzzy  modeling  of  quality 
attributes.  This  research  effort  proposes  that  a  quantitative  approach  applying 
metaheuristic  optimization  techniques  to  integrated  cost  and  dynamic  system  models 
would  significantly  improve  the  perfonnance  and  quality  of  the  system  architecting 
process.  Additionally  this  approach  could  potentially  minimize  inherent  weighting 
towards  favored  or  familiar  technologies  or  designs  associated  with  expert  opinion  based 
architecture  assessment. 

System  Design  Optimization 

Significant  research  has  been  conducted  in  space  system  conceptual  design 
optimization.  This  growing  body  of  research  has  applied  heuristic  design  optimization 
techniques  (i.e.  simulated  annealing,  genetic  algorithms,  or  particle  swann  optimization) 
to  the  conceptual  design  of  space  systems.  Heuristic  algorithms  have  been  widely 
applied  to  optimize  spacecraft  component,  spacecraft  configuration,  and  launch  vehicle 
configuration  conceptual  design  problems.  Additionally  heuristic  algorithms  have  been 
applied  to  Distributed  Task  Constellation  (DTC)  concepts,  and  Distributed  Space  System 
(DSS)  concepts.  These  DTC  and  DSS  concepts  are  analogous  to  some  of  the 
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disaggregation  strategies  previously  identified.  However,  an  integrated  MBCD 
methodology  that  is  capable  of  simultaneously  optimizing  spacecraft  conceptual  designs 
and  disaggregated  architectures  may  represent  a  significant  improvement  in  the 
conceptual  design  of  space  systems  architectures. 

The  use  of  genetic  algorithms  to  optimize  the  configuration  of  a  spacecraft  was 
introduced  by  Mosher  in  1999.  Mosher  introduced  the  Spacecraft  Concept  Optimization 
and  Utility  Tool  (SCOUT)  which  uses  a  genetic  algorithm  to  identify  and  assess  the 
inclusion  of  various  component  technologies  on  a  spacecraft  [15].  These  techniques 
have  been  extended  to  the  conceptual  design  of  numerous  spacecraft  types  and  space 
related  systems  such  as  launch  vehicles  [16]. 

Heuristic  methods  for  optimizing  the  conceptual  designs  of  Distributed  Task 
Constellations  (DTC)  were  introduced  by  Matossian  in  1996.  Matossian  used  a 
simulated  annealing  algorithm  to  identify  the  near-optimal  inclusion  of  legacy  sensors  in 
conceptual  space-based  Earth  Observation  System  (EOS)  designs  according  to  science 
utility  measures  [17],  Matossian’s  concept  of  distributed  task  constellations  is  similar  to 
the  concept  of  multi-function  disaggregation.  The  method  introduced  was  limited  to 
linear  optimization  techniques  to  select  clusters  of  heritage  sensors  for  configuration  of 
notional  spacecraft  based  upon  the  subjective  perfonnance  of  various  Earth  Observing 
System  (EOS)  sensors. 

A  methodology  for  optimizing  distributed  satellite  constellations  was  introduced 
by  Jilla  and  Miller  in  2004.  Their  Multi-objective  Multidisciplinary  Design 
Optimization  Systems  Architecting  (MMDOSA)  methodology  uses  a  simulated  annealing 
algorithm  with  numeric  orbital  simulation  to  optimize  the  conceptual  design  of 
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homogeneous  spacecraft  [18].  The  DSS  concepts  assessed  are  analogous  to  multi-orbit 
disaggregation  problems.  The  MMDOSA  methodology  is  based  upon  modeling  and 
assessing  space  systems  as  networks  of  homogeneous  systems.  Consequently,  the 
methodology  was  limited  to  the  optimization  of  homogenous  spacecraft  types  [19]. 
Selva's  Rule  Based  System  Architecting  (RBSA)  methodology  extended  the  DTC 
optimization  introduced  by  Matossian.  RBSA  included  the  treatment  of  instrument 
selection,  assignment  of  instruments,  and  mission  scheduling  for  a  conceptual  NASA 
EOS  constellation  design  [20].  The  RBSA  approach  represented  a  significant 
progression  in  space  system  conceptual  design  optimization  for  multi-function 
disaggregation  problems.  However,  methodology  was  limited  to  the  clustering  of 
existing  sensors  on  spacecraft  and  does  not  enable  the  optimization  of  sensor/payload  and 
orbital  parameters  for  meeting  system  requirements. 

Based  on  extant  literature,  a  methodology  does  not  exist  that  applies  MBCD 
techniques  to  the  optimization  of  multi-orbit  disaggregation  problems,  where 
heterogeneous  or  mixed  satellite  types  are  possible.  Also,  a  methodology  has  not 
documented  the  optimization  of  multifunction/multi-orbit  disaggregation  concepts  where 
the  individual  spacecraft  system  conceptual  designs  are  optimized  for  the  specific  orbit 
rather  than  the  clustering  of  existing  sensors.  This  paper  presents  the  DISCO 
methodology  and  applies  it  to  a  multi-orbit  disaggregation  problem  where  heterogeneous 
system  types  are  possible. 
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DISCO  Methodology 

The  primary  motivation  for  the  Disaggregated  Integral  System  Concept 
Optimization  (DISCO)  methodology  is  the  enablement  of  improved  system  analysis  and 
optimized  solutions  across  all  disaggregation  types.  An  overview  of  all  potential  logical 
decompositions  is  presented  in  Figure  4. 
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Figure  4.  Disaggregated  space  system  logical  decomposition  strategies  summary 


Figure  5  shows  a  general  overview  of  the  DISCO  approach.  The  general  DISCO 
approach  is  similar  to  the  MMDOSA  approach  presented  by  Jilla  and  Miller,  consisting 
of  the  following  components:  reference  system  architecture,  dynamics  models, 
performance  assessment  models,  and  mixed  variable  optimization  functionality. 
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The  architecture  reference  model  fonns  the  basis  of  the  disaggregated  space  system 
optimization  approach.  The  primary  stakeholder  needs,  mission  objectives,  system 
requirements,  and  logical/physical  architecture  artifacts  are  modeled  in  an  MBSE 
architecture  tool.  The  architecture  reference  model  is  kept  in  concordance  with 
perfonnance/quality  assessment  and  dynamics  simulations  via  engineering  analysis.  This 
concordance  may  be  maintained  via  an  automated  electronic  means  or  through  manual 
manipulation  as  currently  implemented.  Requirements  documented  in  the  architecture 
reference  model  (e.g.  maximum  revisit  rate)  form  the  constraints  of  the  performance 
assessment. 


(performance  constraints,  system  types/  quantities, 
system/subsystem  parameters,  orbit  parameters) 


Figure  5.  DISCO  methodology  MBCD  approach 

The  performance  assessment  models  consist  of  performance  estimating  equations, 
sizing  equations,  and  cost  estimating  equations  that  are  used  to  calculate  the  estimated 
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performance  and  cost  of  candidate  architectures.  Candidate  solutions  (represented  as 
individuals  in  the  genetic  algorithm)  are  evaluated  and  the  estimated  performance  and 
cost  of  the  solution  are  returned  to  the  optimization  routine.  The  dynamics  model 
consists  of  a  numeric  simulation  capability  or  analytic  coverage  estimating  equations 
used  to  assess  the  dynamic  performance  of  the  conceptual  system.  The  dynamics  model 
inputs  candidate  solutions  (individuals)  and  returns  dynamics  related  performance 
measures.  The  optimization  routine  evaluates  the  fitness  of  each  of  the  candidate 
solutions  as  well  as  the  feasibility  (e.g.  constraint  violations)  of  each  of  the  candidate 
solutions.  The  optimization  routine  then  outputs  the  best  feasible  candidate  architecture 
for  further  evaluation. 

The  methodology  assumes  that  the  perfonnance  of  disaggregated  space  architectures  is 
dependent  upon  the  type  of  systems,  the  number  of  systems,  the  perfonnance  of  each 
system,  and  the  orbital  dynamics  of  the  constellation.  The  optimization  component 
outputs  candidate  near-optimal  disaggregated  space  system  architectures  in  the  form  of  a 
design  variables  that  represent  the  number  of  systems  included  in  the  architecture,  the 
critical  design  variables  (i.e.  payload  aperture  diameter)  and  the  constellation  orbital 
parameters.  These  near-optimal  solutions  are  assessed  and  evaluated.  The  candidate 
solutions  and  corresponding  calculated  functions  (i.e.  satellite  mass,  volume,  and  power) 
are  used  to  update  the  reference  architecture. 

The  DISCO  methodology  employs  three  process  steps: 

1 .  Develop  reference  architecture 

2.  Develop  optimization/assessment  models 

3.  Evaluate  solutions  and  update  the  architecture. 
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The  example  problem  presented  in  the  subsequent  application  section  of  this  paper  is 
structured  to  follow  these  DISCO  process  steps. 

Develop  Reference  Architecture 

Reference  architectures  can  be  viewed  as  a  template  for  system  solutions  based 
upon  a  generalized  set  of  solutions.  According  to  the  INCOSE  SE  handbook  it  is  critical 
that  a  reference  architecture  be  created  in  the  early  stages  of  the  conceptual  design  of  a 
system  to  “whatever  depth  is  necessary  to  identify  technological  risks,  assess  technology 
readiness,  and  generate  early  cost  and  schedule  projections”  for  a  program  [13].  The 
DISCO  methodology  adopts  four  steps  from  the  Object  Oriented  Systems  Engineering 
Method  (OOSEM)  “specify  and  design  system  process”  in  order  to  develop  a  reference 
architecture  [21].  Accordingly,  the  four  tasks  used  to  develop  reference  architectures  are: 

1 .  Analyze  stakeholder  needs 

2.  Analyze  system  requirements 

3.  Define  logical  architecture 

4.  Synthesize  candidate  physical  architectures 

Analyze  Stakeholder  Needs 

Stakeholder  needs  can  be  analyzed  and  established  via  numerous  methods 
including  stakeholder  elicitation  and  causal  analyses  comparing  existing  capabilities  and 
desired  capabilities.  Accurately  assessing  needed  mission  functions  and  their 
corresponding  measures  of  effectiveness  is  critical  to  the  effective  application  of  DISCO. 
The  DISCO  optimization  model  is  currently  structured  to  assess  operational  cost 
effectiveness  as  the  primary  Measures  of  Effectiveness  (MOE)  by  minimizing  estimated 
life  cycle  cost  (LCC)  subject  to  performance  requirements.  However  it  should  be 
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possible  to  structure  the  optimization  objective  function  as  a  value  function.  Future 
research  is  planned  to  assess  alternative  optimization  model  formulations  to  maximize  the 
weighted  value  model  subject  to  varying  performance  constraints.  Analysis  of 
stakeholder  needs  concludes  with  the  documentation  of  mission  needs,  mission 
objectives,  mission  requirements,  measures  of  effectiveness,  enterprise  use  cases,  and  an 
operations  concept  documented  in  the  reference  architecture.  These  items  should  be 
documented  in  an  MBSE  software  tool  in  the  corresponding  requirements  diagrams,  use 
case  diagrams,  and  block  definition  diagrams. 

Analyze  System  Requirements 

System  requirements  for  DISCO  applications  are  analyzed  via  traditional  MBSE 
means  such  as  mission  scenario/system  context  assessment  and  identification  of  critical 
system  properties  and  constraints.  The  output  of  this  analysis  is  the  documentation  of 
system  requirements  in  requirements  diagrams  contained  in  the  reference  architecture 
model.  Accurate  identification  of  space  system  performance  requirements  is  critical  for 
the  analysis  of  disaggregated  space  systems.  These  requirements  often  fall  into  the 
general  categories  of  coverage,  refresh  rates  (such  as  revisit),  mission  data  delivery  and 
dissemination  timeliness,  mission  data  geolocation,  and  mission  data  accuracy/sensitivity 
requirements.  The  DISCO  methodology  varies  from  other  distributed  space  system 
optimization  methods,  such  as  MMDOSA,  by  incorporating  space  system  performance 
requirements  as  constraints  in  the  design  optimization  model.  DISCO  models  these 
system  requirements  as  constraints  that  can  be  varied  to  perform  requirements  trade 
studies.  This  requirements  traceability  often  requires  the  modeling  of  estimated  payload 
or  sensor  performance.  Consequently,  physics  based  models  are  necessary  to  determine 
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the  estimated  payload/sensor  performance.  This  analysis  sometimes  requires  subsystem 
and  component  modeling  that  is  traditionally  abstracted  during  system  architecture 
studies. 

Define  Logical  Architecture 

Defining  the  logical  architecture  is  a  critical  step  in  the  DISCO  methodology. 
During  this  process  task  the  system  is  decomposed  into  logical  components  and  the 
interconnections  needed  to  satisfy  system  requirements  are  described  (Friedenthal,  Moore 
and  Steiner  2011).  The  logical  decomposition  forms  the  framework  for  the  disaggregated 
space  system  optimization.  The  varying  disaggregation  strategies  summarized  in  Figure 
4  represent  the  various  logical  decomposition  strategies. 

Synthesize  Candidate  Physical  Architectures 
The  transition  from  a  logical  architecture  to  a  candidate  physical  architecture  is  a 
critical  step  for  the  DISCO  methodology.  The  reference  logical  architecture  is 
decomposed  into  logical  and  physical  nodes.  The  distribution  of  functions  to  specific 
payloads/sensors  and  orbital  compartments  represent  the  transition  from  a  logical  node 
architecture  to  a  physical  node  architecture.  Ultimately,  the  DISCO  optimization  routine 
produces  size,  weight,  and  power,  and  performance  estimates  for  the  spacecraft  and  the 
mission  payload.  These  estimates  are  used  to  update  the  physical  architecture  block 
definition  diagrams  with  initial  specification  values.  These  specification  values  can  then 
be  used  as  technical  performance  measures  to  assess  development  status  in  the  system 
development  life  cycle  stage. 
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Develop  assessment/optimization  models 

Cost  Assessment  Models 

Life-cycle  costs  for  space  systems  are  traditionally  calculated  using  cost 
estimating  relationships  derived  from  historical  programs.  Several  relevant  parametric 
cost  models  have  been  previously  developed  including  the  Unmanned  Satellite  Cost 
Model  (USCM),  the  Small  Satellite  Cost  Model  (SSCM)  and  the  NASA  Instrument  Cost 
Model  (NICM).  The  DISCO  methodology  enables  the  identification  of  system  types 
within  these  corresponding  cost  model  parameters. 

Performance  Assessment  Models 

Perfonnance  assessment  models  for  disaggregated  space  systems  are  scenario  and 
technology  dependent.  The  needed  perfonnance  models  are  linked  to  the  space  system 
perfonnance  requirements  determined  in  the  analyze  system  requirements  task  of 
developing  an  architecture  model.  The  perfonnance  models  output  expected 
perfonnance  values  for  candidate  architecture.  These  performance  values  are  then 
evaluated  as  part  of  the  constraint  equations. 

Dynamics  Assessment  Models 

Assessment  of  spacecraft  dynamics  is  integral  to  the  evaluation  of  disaggregated 
space  systems.  Space  systems  are  commonly  evaluated  for  dynamics  related 
requirements  such  as  coverage  and  revisit  rates.  The  dynamics  of  individual  systems 
vary  in  a  disaggregated  space  system  context.  Consequently  dynamics  models  must  be 
developed  that  are  capable  of  determining  whether  space  vehicles  are  capable  of  meeting 
these  requirements.  Coverage  models  are  commonly  based  upon  analytic  models  and 
numerical  simulations.  Analytic  models  can  estimate  area  access  rates  and  consequently 
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can  be  used  to  estimate  percent  coverage  for  a  specific  time  or  revisit  rates.  Numeric 
simulations  are  required  to  accurately  calculate  revisit  rates  and  coverage  figures  of 
merit.  This  is  especially  true  for  discontinuous  or  regional  based  coverage  areas  and 
distributed  systems  where  coverage  overlaps  exist.  The  DISCO  methodology  enables 
analytic  dynamic  assessment  as  well  as  numeric  simulation  assessment. 

Optimization  Models 

The  DISCO  methodology  is  intended  to  analyze  architectural  problems  where 
perfonnance  and  cost  are  dependent  upon  the  number  and  type  of  dynamic  systems  in  the 
architecture,  as  well  as  the  perfonnance  of  individual  sensors  or  payloads.  The 
optimization  of  a  disaggregated  space  system  is  dependent  upon  an  integrated 
constellation  design  (evaluated  via  a  dynamics  model)  and  the  conceptual  spacecraft 
design  (evaluated  via  the  perfonnance  models).  The  integration  of  these  two 
components  is  structured  via  a  mathematical  optimization  model.  For  example,  the 
probability  of  detection  of  a  space-based  remote  sensing  system  is  dependent  upon  the 
number,  orbit,  and  conceptual  type  of  satellites  in  the  architecture.  Design  problems  with 
mixed  integer  problem  formulations  fall  into  the  category  of  problems  known  as  Mixed 
Variable  Optimum  Design  Problems  (MV-OPT)  [22], 

The  general  mathematical  model  of  a  MV-OPT  design  problem  is: 

Minimize 

/(*) 

subject  to: 

hi(x)  =  0,  i  —  1.  .p, 
gj(x)  <  0  ,j  =  1. .  m 

XjfDj,  D[  i_d.ii,  dfe, ... ,  diq i  1. .  Tiq 
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xiL  <  Xi  <  xw,  i  —  (nd  +  1). .  (nd  +  nc) 


where, 

f(x)  is  the  optimization  objective  function, 
x  is  the  vector  of  design  variables  (x{) 
h,  represents  the p  equality  constraint  functions, 
g  represents  the  in  inequality  constraint  functions, 

xiL  and  xnj  are  the  lower  and  upper  bounds  for  one  of  the  nc  continuous  variables, 
nd  is  the  number  of  discrete  design  variables, 

Dj  is  the  set  of  discrete  values  for  the  ith  variable, 
qt  is  the  number  of  allowable  discrete  values;  and 
dik  is  the  kth  possible  discrete  value  for  the  7th  variable. 


The  current  formulation  for  a  general  DISCO  problem  is  an  extension  of  this  MV- 
OPT  formulation.  The  DISCO  extension  of  the  general  mathematical  optimization  model 
represent  a  Mixed  Integer  Non-Linear  Programming  (MINLP)  formulation  where  the 
objective  function  is  the  estimated  system  life-cycle  cost  which  is  dependent  upon  the 
integer  formulation  of  the  system  type  configuration  and  non-linear  constraint  equations. 

The  corresponding  DISCO  mathematical  optimization  formulation  is1: 

Minimize 


/(*) 


subject  to 


where 


11 

I 

i=  1 


cdevx  dev 


.  prod  prod 
+  Ci  Xi 


+  Clopsxtops 


.  supt  supt 
+  Ci  Xi 


+  c\etx\et 


hj  =  0,i  =  1  ..p, 

gj  <  0,j  =  1  ..m 

XieDi,  Di  (dji;  d(2<  ■■■  >  d-iq^,  i  1 . .  Tiq 
xiL  <Xi<  xw,  i  =  (nd  +  1). .  (nd  +  nc) 
rdev  _  (1  if  X?r0d  >  0) 

1  t  else  0  j 


1  Note  that  the  optimization  objective  function  is  a  non-linear  and  discrete  function  despite  initial 
appearances.  The  estimated  system  cost  terms  (cfev,  cf1  od,  c°ps ,  csjuvt ,  c{et )  are  functions  of  the  problem 
design  variable  vector  (x)  for  satellite  system  types.  Additionally,  the  system  number  terms 
(xfev,xfrod,x°ps,x[upt,x[et)  are  also  functions  of  the  problem  design  variable  vector  (x)  and  can  only 
have  integer  values. 
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f(x)  represents  the  estimated  system  Life  Cycle  Cost  (LCC)  (objective  function) 

cdev  represents  the  estimated  development  cost  for  system  type  i 

xdev  represents  the  number  of  development  systems  of  type  i 

cprod  represents  the  estimated  production  cost  for  system  type  i 

xfrod  represents  the  number  of  production  systems  of  type  i 

c°ps  represents  the  estimated  operations  cost  for  system  type  i 

x°ps  represents  the  number  of  systems  of  type  i  that  require  operations 

csupt  represents  qlc  estimated  support  cost  for  system  type  i 

x™pt  represents  the  number  of  systems  of  type  i  that  require  support/sustainment 

clet  represents  the  estimated  retirement  cost  for  system  type  i 

x[et  represents  the  number  of  systems  of  type  i  that  require  retirement/disposition 

n  represents  the  number  of  system  types 


The  optimization  objective  function  described  above  is  a  summation  function  of 
cost  tenns  (q),  and  tenns  associated  with  the  number  of  systems  of  type  i  (xt ).  The  cost 
coefficients  are  categorized  based  upon  the  life-cycle  phases  (i.e.  development, 
production,  operations,  support,  and  retirement).  The  life-cycle  phases  used  in  this 
fonnulation  are  organized  according  to  the  life-cycle  stages  outlined  in  the  INCOSE 
handbook  [13].  For  example,  the  cost  term  (cfev)  represents  the  estimated  system 
development  cost  for  system  type  i.  Therefore,  the  summed  product  £f=1  cdevxfev 
represents  the  total  estimated  development  costs  for  all  systems  in  the  architecture.  The 
cost  tenn  cprod  represents  the  estimated  production  cost  associated  with  system  type  i. 
Therefore  the  summed  product  £f=1  cprodxprod  represents  the  total  estimated  system 
production  costs.  The  costs  for  operations,  support  (i.e.  sustainment  and  satellite 
replacement  costs)  and  retirement  are  calculated  similarly  as  applicable.  The  tenn  xdev  is 
calculated  from  the  value  of  xfrod;  if  xprod  is  greater  than  zero,  xdev  equals  one,  else 
xdev  equals  zero.  The  minimized  objective  function  then  represents  the  minimum 
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disaggregated  system  estimated  life-cycle  costs  for  the  analyzed  life-cycle  components 
subject  to  physical  and  performance  constraints. 

The  DISCO  methodology  has  been  applied  using  a  genetic  algorithm.  There  are 
multiple  reasons  for  the  choice  of  a  genetic  algorithm.  First,  space  systems  constellation 
design  problems  have  “practical  limits  on  coverage  analysis  with  objective  functions  that 
are  not  differentiable,  so  non  gradient-based  optimization  methods  are  necessary”  [23]. 
Secondly,  stochastic  optimization  techniques  such  as  simulated  annealing  and  genetic 
algorithms  have  been  widely  used  for  space  system  optimization  problems,  and  continue 
to  show  significant  promise.  Finally,  a  genetic  algorithm  was  chosen  due  to  availability 
in  analysis  tools  that  are  easily  integrated  within  the  MBSE  framework.  Industry  standard 
genetic  algorithm  software  routines  are  available  that  allow  non-linear  constraint 
functions,  mixed-variable  (i.e.  discrete  and  continuous)  design  variables,  and  multi¬ 
objective  optimization.  These  capabilities  are  necessary  for  the  DISCO  methodology 
based  upon  the  MVOPT  fonnulation. 

Evaluate  solutions  and  update  architecture 

The  output  of  the  DISCO  optimization  routine  is  a  design  vector  (jc)  and  the 
corresponding  estimated  parameters  that  represent  a  candidate  physical  architecture 
solution.  The  results  should  be  assessed  for  accuracy,  global  optimality,  and  if  possible, 
sensitivity  to  requirements  and  stochastic  parameters.  After  results  are  sufficiently 
evaluated,  the  reference  architecture  (particularly  the  physical  block  definition  diagram) 
can  be  updated  with  the  estimated  parameters. 
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Evaluate  solutions 


A  summary  of  the  general  DISCO  optimization  and  results  evaluation  routine  is 
summarized  in  Figure  6.  The  internal  loop  is  representative  of  a  standard  genetic 
algorithm  where  an  initial  population  is  iteratively  generated,  evaluated,  reproduced, 
crossed-over,  mutated,  assigned  a  penalty  value,  and  assessed  for  convergence  criteria. 
The  results  from  each  individual  trial  should  be  verified  for  physical  and  design 
limitations  to  ensure  that  the  overall  model  is  coded  correctly.  An  external  loop  is  then 
used  to  perform  multiple  optimization  trials  as  a  common  global  optimization  technique. 
Confidence  in  the  candidate  solution  is  gained  by  adopting  the  best  solution  from 
multiple  GA  trials,  this  method  is  similar  to  a  multi-start  global  optimization  technique 
[22]. 

The  outennost  loop  can  then  be  used  to  conduct  requirements  trade  studies.  A 
requirement  (such  as  max  revisit  time)  can  be  varied  from  threshold  to  objective  values. 
The  corresponding  sensitivity  analysis  results  can  then  be  used  to  detennine  the  Pareto 
front  of  estimated  LCC  vs.  varied  requirements  values.  Additionally,  the  outermost  loop 
can  be  used  to  detennine  the  impact  of  stochastic  parameters.  The  stochastic  parameter 
can  be  varied  according  to  an  assumed  probability  distribution.  Monte  Carlo  methods 
can  then  be  used  to  determine  the  impact  of  the  random  variables  on  the  performance  of 
the  system.  A  similar  technique  using  a  Monte  Carlo  method  was  discussed  by 
Aliakbargolkar  and  Crawley  for  the  conceptual  architecting  of  resource  extraction 
systems  [24] .  Once  the  candidate  solutions  have  been  evaluated  sufficiently  then  the 
corresponding  best  solution  can  be  used  to  update  the  reference  architecture  as  a 
reference  physical  architecture  design. 
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Figure  6.  DISCO  optimization/results  evaluation  routine 


Updating  the  Architecture 

Finally,  the  conceptual  reference  architecture  is  updated  based  upon  the  chosen 
candidate  solution  from  the  optimization  and  evaluation  technique.  Feasible  solutions 
represent  conceptual  architectures  that  meet  performance  requirements.  The  number  and 
types  of  systems  in  the  chosen  candidate  solution  are  identified  in  the  block  definition 
diagrams  of  the  reference  architecture  as  enumerations.  Calculated  parameters  associated 
with  the  chosen  solution  (i.e.  preliminary  size,  weight,  and  power  estimates)  are  added  to 
the  block  diagrams  and  parametric  diagrams  where  applicable.  These  conceptual 
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estimated  parameters  can  then  serve  as  candidate  technical  perfonnance  measures  for 
subsequent  preliminary  and  detailed  engineering  design  phases. 

Fire  detection  problem 

A  notional  early  warning  space-based  fire  detection  system  is  presented  to 
demonstrate  the  utility  of  the  DISCO  methodology  to  generate  and  assess  optimized 
conceptual  designs.  Using  the  requirements  as  performance  constraints,  we  examine 
designs  on  a  cost  versus  perfonnance  basis  to  address  this  urgent  need. 

OFUEGO  Reference  Architecture 

The  development  of  the  reference  architecture  is  based  upon  the  process  steps 
outlined  in  develop  reference  architecture  section  of  this  paper,  and  applied  to  the  Fire 
Urgency  Estimator  in  Geosynchronous  Orbit  (FUEGO)  problem  described  in  [25]  and 
[26].  The  solution  from  DISCO  will  be  referred  to  as  the  Optimized  FUEGO 
(OFUEGO). 

Analyze  Stakeholder  Needs 

Stakeholder  needs  are  first  assessed  by  characterizing  the  as-is  system  and 
enterprise.  Every  year,  billions  of  dollars  are  spent  on  fire  suppression  globally  with  an 
annual  U.S.  fire  suppression  budget  of  approximately  one  billion  dollars  [25].  Additional 
monetary  and  humanitarian  damages  are  caused  by  out  of  control  fires  that  are  not 
suppressed  in  a  timely  fashion  due  to  a  lack  of  early  detection  and  notification  capability. 
Current  fire  detection  methods  rely  on  outdated  fire  spotters  in  towers,  or  multi-purpose 
space-based  environmental  sensors.  Space-based  fire  detection  data  is  derived  from 
multi-purpose  environmental  earth  observation  payloads  such  as  MODIS  (Moderate 
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Resolution  Infrared  Spectrometer)  on  the  Aqua  and  Terra  satellites,  part  of  the  EOS. 
Additionally,  the  imaging  payloads  on  the  Geostationary  Operational  Environmental 
Satellites  (GOES)  are  capable  of  detecting  large  fires.  These  systems  do  not  provide  the 
sensitivity  and  revisit  rate  necessary  to  identify  small  fires  early  when  they  can  be  most 
easily  suppressed. 

The  general  operations  concept  for  a  space-based  fire  detection  and  monitoring 
system  is  shown  in  Figure  7.  A  satellite  detects  a  heat  signature  associated  with  a 
developing  fire.  It  processes  and  geo-locates  the  heat  signatures  and  sends  a  warning  of 
the  potential  forest  fire  location  and  intensity  to  an  operations  center.  A  satellite  continues 
to  provide  tracking  updates  of  the  fire.  Operators  disseminate  the  fire  alert  information  to 
a  dispatch  service,  where  firefighters  can  then  respond. 
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Figure  7.  FUEGO  Operational  Concept,  derived  from  [27]. 

Analyze  System  Requirements 

OFUEGO  system  requirements  were  determined  by  analyzing  and  consolidating 
performance  requirements  summarized  in  [26]  and  [25].  These  consolidated  performance 
requirements  are  summarized  and  compared  to  the  approximate  performance  of  existing 


systems  in  Table  1. 


Table  1 

.  OFUEGO  space  system  requirements  summary 

Current  Capability 
(GOES) 

Current  Capability 
(EOS) 

Requirements 

(OFUEGO) 

Target  Characteristics 

Large  fires 

Large  fires 

Developing  fires 

Coverage  Area 

North  /  South  America 

Global 

Critical  regions  37-46°  N/S 

Min  Detectable  Fire 

-3 ,000m2  1100K  fire 

~200nr  1100K  fire 

50m2  1 100K  fire  (SNR=90) 

Probability  of  Detection,  Pd 

unspecified 

unspecified 

Pj  >  95%  within  25  min 

Revisit  Interval 

Avg~15  min  Max  ~15  min 

Avg  ~4.4  hrs  Max  -8.7  hrs 

Avg  <15  min  Max  <25  min 

Mapping  Accuracy 

-8  km 

-500  m 

<  500  m 

Fire  Detection  Timeliness 

~1  hr,  based  on  fire  growth 

-12  hrs 

<  30  min 
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The  reference  architecture  for  the  proposed  OFUEGO  mission  consists  of 
satellites,  a  ground  system,  launch  vehicles,  operators,  users  and  the  interfaces  between 
these  systems  and  actors.  The  initial  analysis  focuses  on  the  space  segment  and  launch 
vehicle  selection  as  the  primary  drivers  for  the  overall  life  cycle  costs.  The  potential 
system  types  for  a  disaggregated  OFUEGO  solution  were  modeled  in  the  reference 
architecture  and  are  summarized  in  Figure  8.  The  legacy  capability  represented  by  on- 
orbit  MODIS  sensors  could  be  added  to  the  optimization  problem  as  available  systems; 
however,  they  are  currently  excluded  to  simplify  the  example. 

Develop  FUEGO  Assessment/  Optimization  Models 
Cost  assessment  model 

Two  space  system  cost  models  are  used  for  this  application  of  the  DISCO 
methodology.  The  first  cost  model  is  the  Unmanned  Space  System  Cost  Model  (USCM). 
This  cost  model  was  developed  by  the  U.S.  Air  Force  and  is  primarily  intended  to 
estimate  the  cost  of  large  operational  satellites.  Specifically,  the  USCM  8  variant  of  the 
cost  model  is  used  for  this  application. 
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Figure  8.  OFUEGO  Logical  Node  Architecture  Summary 


The  second  cost  model  used  for  the  OFUEGO  example  is  the  Small  Satellite  Cost  Model 
(SSCM)  developed  by  the  Aerospace  Corporation.  The  SSCM  is  primarily  intended  to 
estimate  the  cost  of  small  satellites  as  the  name  implies.  The  cost  model  was  based  upon 
data  from  primarily  stand-alone  small  research  and  development  satellites.  The  USCM 
and  SSCM  models  are  used  to  calculate  the  cost  coefficient  dependent  variables  in  the 
objective  function.  The  estimated  satellite  development  and  production  costs  were 
estimated  using  the  corresponding  cost  estimating  relationships  summarized  in  the  Space 
Mission  Analysis  and  Design  (SMAD)  textbook  [28].  SMAD  was  also  used  to  estimate 
the  production  costs  for  the  launch  vehicles. 

Performance  Assessment 

The  probability  of  fire  detection  is  the  driving  system  measure  of  effectiveness. 
The  system  probability  of  detection  is  calculated  using: 

pd  =  PCPS 

where 

Pd  is  the  system  probability  of  detection, 

Ps  is  the  probability  of  signal  detection,  and 
Pc  is  the  probability  of  coverage. 

The  probability  of  coverage  for  the  required  25  minute  max  revisit  period  is  equivalent  to 
the  percent  coverage  calculation  for  the  same  time  period.  A  100%  probability  of 
coverage  for  a  given  25  minute  time  period  is  also  equivalent  to  a  max  revisit  of  less  than 
25  minutes.  Percent  coverage  is  calculated  numerically  by  dividing  the  number  of  points 
in  a  given  region  covered  in  a  period  of  time  by  the  total  number  of  points  in  a  region. 


The  probability  of  signal  detection  is  significantly  more  complicated  to  calculate 
numerically  because  it  is  dependent  upon  the  detection  algorithm,  sensor  characteristics, 
and  environmental  factors  such  as  the  presence  and  optical  thickness  of  smoke.  The 
SMAD  text  assumes  an  SNR  value  of  88  is  acceptable  for  a  low  fire  detection  false  alann 
rate  based  upon  heritage  (MODIS)  sensor  performance  [28].  A  similar  SNR  value  of  100 
was  identified  as  sufficient  for  fire  detection  in  [25].  Likewise  we  assume  a  SNR  of 
greater  than  100  was  sufficient  for  fire  detection.  The  equation  for  calculating  SNR  was: 


SNR 


Signal  Signalfire 

Noise  I  j  "  7  j- 

noise/ire  +  noised  +  noise^et 


[2] 


where 

Signalfue  is  the  number  of  electrons  received  at  the  detector  for  a  1 100K  fire  that  radiates 
from  a  50  m2  area  on  earth, 

noisebg  (background)  is  the  number  of  electrons  received  at  the  detector  for  the  projected 
surface  area  of  one  pixel, 

noisedet  (detector)  is  the  number  of  noise  electrons  per  pixel  for  the  assumed  focal  plane, 


The  Signalfire  is  estimated  using  Planck’s  equation  at  1 100K  and  the  signal  of  the 
background  is  estimated  using  Planck’s  equation  at  300K  (the  approximate  temperature 
of  earth’s  surface  at  noon).  This  calculation  method  is  discussed  in  more  detail  in  [29], 

Dynamics  Assessment  Model 

Systems  Tool  Kit  (STK)  software  was  used  as  the  dynamics  model  for  this 
application.  Spacecraft  objects  are  created  according  to  the  corresponding  design 
variables  and  calculated  sensor  parameters  (i.e.  horizontal  and  vertical  half  angles).  The 
probability  of  coverage  is  calculated  using  the  STK  coverage  figure  of  merit.  The 
scenario  is  modeled  for  the  fire  detection  timeliness  requirement  of  25  minutes.  A 
physical  constellation  is  modeled  based  upon  the  current  design  variables.  A  coverage 
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figure  of  merit  is  modeled  based  upon  the  corresponding  coverage  area  requirement.  The 
coverage  area  is  divided  into  1  degree  increments.  The  total  probability  of  coverage  is 
then  calculated  by  dividing  the  number  of  points  covered  in  the  required  timeframe  by  the 
total  number  of  points. 

Optimization  Model 

The  OFUEGO  optimization  formulation  was  developed  according  to  the  DISCO 
methodology  for  the  identified  system  types  and  design  variables,  summarized  as2: 


Minimize 


fix)  =  c{evx 


dev 

1 


,  „dev  v dev  ,  „ dev v dev 
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+ 
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subject  to 


->  Aisp  -  Nlv  =  0 

#i(*)  ms-lc  <  0 

g2(*)  — Pd  +  0.95  <  0 

gUl(x)  ->  -5/VR  +  100  <  0,/or  i  =  1.3 
di,2 (*)  —MA  +  500  <  0  for  i  —  1.  .3 
SqW  -»  -GSDdiff  +  GSD  <  0  for  i  =  1.3 


x, 


f0  if  xj  =  0) . . 
I  else  1  J ' 1 


i,  0 


1..9 


XieDi,  Dt  =  (1 ...  200),  i  =  1. .  3 
Xj  =  1,  i  =  4 

XjfD^Dj  =  (1  ...20),i  =  5.. 9 


Xj  =  Xj;1  *  Xj  2;  i  =  1.  .3 
0  <  Xj  3  <  p  —  1;  i  =  1..3 


2  Note  that  the  optimization  objective  function  is  a  non-linear  and  discrete  function  despite  initial 
appearances.  The  estimated  system  cost  terms  (cf ' ev ,  cf1  od,  c°ps ,  csjulpt ,  c[et)  are  functions  of  the  problem 
design  variable  vector  (x)  for  satellite  system  types.  Additionally,  the  system  number  terms 
(xfev,xprod,x°ps,x^upt,x[et)  are  also  functions  of  the  problem  design  variable  vector  (x)  and  can  only 
have  integer  values.  The  xis  terms  identified  in  the  optimization  formulation  are  system  specific  design 
variables  included  in  the  design  variable  vector  (x). 
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0  <  xiA  <  360;  i  =  1.3 
200  <  xtls  <  35,786;  i  =  1.  .3 
0  <  Xj  6  <  0;  i  =  1.  .3 
0  <  Xj 7  <  99;  i  —  1.3 
0  <  xi8  <  360;  i  —  1.3 
0  <  xi  9  <  360;  i  —  1.3 
0  <  Xj  10  <  360;  i  =  1.3 
0.2  <  Xj;11  <  1;  i  =  1 
0  <  Xj;11  <  360;  i  =  2,3 

where 

f  (pc)  is  the  estimated  OFUEGO  LCC 

ht  (x)  is  the  minimum  launch  vehicle  (LV)  constraint 

Nsp  is  the  total  number  of  satellite  planes 

Ntv  is  the  total  number  of  launch  vehicles 

gt(x)  is  the  minimum  LV  lift  capacity  constraint 

Ms  is  the  total  mass  of  satellites  (kg) 

LC  is  the  total  LV  lift  capacity  (kg) 

g2  (x)  is  the  minimum  probability  of  detection  constraint 

Pd  is  the  OFUEGO  constellation  probability  of  detection 

g j  x  (x)  is  the  fire  detection  minimum  SNR  constraint 

SNR  is  the  estimated  signal  to  noise  ratio 

di,2  (x)  is  the  maximum  mapping  accuracy  constraint 

MA  is  the  estimated  sensor  mapping  accuracy  (m) 

9i,3  (x)  is  the  optical  diffraction  limit  constraint 
GSD  is  the  G  (m) 

Xjj  is  the  number  of  satellite  planes  (p) 

Xit2  is  the  number  of  satellites  per  plane  (5) 

Xj  3  is  the  walker  constellation  RAAN  spacing  (f) 

Xj  4  is  the  walker  constellation  RAAN  spread  (Q  ) 

Xj  5  is  the  seed  satellite  orbital  height  (h) 

Xj  6  is  the  seed  satellite  orbital  eccentricity  ( e ) 

Xj  7  is  the  seed  satellite  orbital  inclination  (/) 

Xj  8  is  the  seed  satellite  RAAN  (Q) 

Xj  8  is  the  seed  satellite  argument  of  perigee  (o>) 

Xj  10  is  the  seed  satellite  true  anomaly  (v) 

Xj;11  is  the  sensor  aperture  diameter  (Ad) 

Xj j  E  x;gUj(x)  E  g(x); 

Currently,  the  estimated  OFUEGO  operations  cost  tenn  (cops)  and  ground  system 
development  and  production  costs  are  assumed  to  be  fixed  values  independent  of  the 
OFUEGO  concept  design.  Consequently  cops  is  assumed  to  be  $25M,  c/ev  is  assumed  to 
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be  $20M,  and  c\rod  is  assumed  to  be  $5M;  The  total  number  of  satellite  planes  Nsp  is 
calculated  by  summing  the  number  of  planes  ip)  for  all  three  satellite  types.  The  total 
number  of  launch  vehicles  N[v  is  calculated  by  summing  the  number  of  launch  vehicles 
(xi)  for  i=5.. 9  associated  with  the  five  previously  identified  launch  vehicle  types. 

The  fire  detection  sensor  aperture  diameter  ( Ad )  represents  the  most  critical  design 
variable  in  the  OFUEGO  optimization  problem.  The  concept  aperture  diameter 
establishes  the  estimated  mass  of  the  fire  detection  payload  and  consequently  the 
estimated  mass  and  cost  of  a  conceptual  fire  detection  satellite.  The  approach  used  to 
estimate  the  mass  of  a  satellite  is  based  upon  scaling  relationships  with  existing  similar 
payloads.  The  scaling  equations  used  for  the  OFUEGO  design  are: 

Ad 


R  = 


Ar 


Mp~KR3M0 


[4] 


[5] 


where 

R  is  the  aperture  diameter  ratio, 

Ad  is  the  aperture  diameter  of  the  design  payload, 

A0  is  the  aperture  diameter  of  the  reference  payload, 

Mp  is  the  estimated  mass  of  the  conceptual  payload; 

Ma  is  the  mass  of  the  reference  payload,  and 
K  is  a  constant  that  addresses  small  R  values. 

The  constant  K  is  assumed  to  be  2  if  R  is  less  than  0.5. 

Sizing  estimates  are  constrained  to  R  values  greater  than  0.2  and  less  than  5.  These  sizing 
relationship  equations  and  other  sizing  relationships  are  discussed  in  detail  in  the  SMAD 
textbook  [1].  These  sizing  relationships  also  serve  as  a  proxy  sizing  relationship  for 
varying  payload  types  (i.e.  whiskbroom  or  push-broom  sensors)  as  the  relative  mass  for 
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whiskbroom  scanners  are  larger  than  push-broom  sensors  for  comparative  aperture 
diameters.  Using  this  simple  sizing  relationship  it  would  appear  that  determining  the 
minimum  cost  satellite  constellation  design  would  be  as  simple  as  determining  the 
minimal  payload  aperture  diameter  and  propagating  the  minimal  number  of  satellites 
based  upon  that  payload  to  meet  coverage  and  revisit  requirements.  However,  the 
complex  interaction  of  satellite  constellation  design  variables  in  a  disaggregated  system 
makes  this  extremely  difficult  task  due  to  conflicting  combinatorial  trades.  A  summary  of 
the  conflicting  combinatorial  trades  are  summarized  in  Figure  9.  The  relative 
disadvantages  are  shown  as  arrows  to  the  left  and  the  relative  advantages  are  shown  as 
arrows  to  the  right.  This  conflicting  combinatorial  trade-space  is  the  primary  reason  for 
using  a  computer  aided  optimization  algorithm. 


Payload  /  Satellite  size 


'T 

A 


decreased  performance 


increased  cost 


Satellite  altitude 


V 


decreased  cost 


A 


Number  of  launch  vehicles 


Push-broom  sensor 


decreased  field  of  view 


better  sensitivity 


Whiskbroom  sensor 


r 


increased  field  of  view 


Figure  9.  Conflicting  OFUEGO  combinatorial  trade  summary 
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Evaluate  OFUEGO  Solutions 


The  candidate  solutions  from  the  FUEGO  optimization  routine  consist  of 
estimated  life-cycle  costs,  design  variable  values,  and  associated  technical  perfonnance 
measures  such  as  estimate  mass  and  estimated  payload  perfonnance  measures  (i.e.  SNR). 
The  reference  architecture  was  updated  according  to  the  techniques  provided  in  the 
synthesize  candidate  physical  architectures  section. 

Evaluate  OFUEGO  Solutions 

The  integrated  optimization  and  simulation  routine  was  executed  and  analyzed  via 
multiple  experimental  trials  according  to  the  global  optimization  technique  discussed  in 
the  optimization  models  section.  Ten  trials  were  conducted  with  five  of  the  ten  trials 
resulting  in  a  feasible  constellation  design  with  an  estimated  LCC  between  $141M  - 
$161M.  These  constellation  designs  all  consisted  of  12  small  whiskbroom  satellites  in 
three  planes  of  four  satellites,  using  three  Minotaur  launch  vehicles. 

Four  other  solutions  consisted  of  constellations  based  upon  larger  numbers  of 
small  push-broom  satellites  with  estimated  LCC  between  $385M  and  $683M.  These 
candidate  solutions  appeared  to  converge  on  a  local  minimum  associated  with  small 
push-broom  satellite  constellations.  The  final  candidate  solution  consisted  of  3  large 
whiskbroom  satellites  and  had  an  estimated  LCC  of  $618M.  The  number  of  similar 
solutions  in  the  solution  set  provided  confidence  in  the  architectural  solution. 
Additionally,  all  of  the  identified  local  optimization  solutions  consisted  of  homogeneous 
satellite  constellations  indicating  a  potential  preference  towards  homogeneous  satellite 
constellation  solutions  for  this  problem.  It  was  noted  that  none  of  the  near  optimal 
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solutions  contained  heterogeneous  or  mixed  system  types.  The  best  solution  design  vector 
from  the  10  trials  was  selected  and  summarized  in  Table  2. 


Table  2.  Design  vector  of  the  OFUEGO  solution 


Design  Vector  (.v) 

System  Type  3 

System  Type  4 

Description 

Small  whisk 
broom 

Minotaur  4  Launch  Vehicle 

x,(#) 

12 

3 

pm 

3 

m 

4 

f 

0 

Q*(°) 

360 

h(km) 

1166 

e(°) 

0.0 

iC) 

48 

con 

130 

an 

108 

304 

A/m) 

0.014 

The  near-optimal  constellation  design  solution  identified  is  a  3/4  Walker  constellation  of 
12  small  whiskbroom  scanning  satellites  with  a  0.014m  diameter  infrared  optic  system  at 
1166  km  orbital  height.  A  2-dimension  representation  of  the  constellation  design  solution 
is  displayed  in  Figure  10.  The  associated  probability  of  coverage  Pc  for  the  highlighted 
region  in  a  25  minute  period  is  100%.  The  maximum  revisit  rate  was  calculated  as  25 
minutes.  The  average  revisit  for  the  points  in  the  identified  region  was  calculated  at 
approximately  15  minutes. 
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Figure  10.  OFUEGO  constellation  design  overview 
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bdd  [Package]  Design  Model  [OFUEGO  Conceptual  Design  Model] 


Figure  11.  Updated  OFUEGO  architecture  summary 


48 


Update  OFUEGO  Architecture 


The  resulting  optimized  conceptual  design  was  used  to  update  the  reference 
architecture.  Figure  1 1  displays  the  updated  OFUEGO  conceptual  architecture  summary. 
The  multiplicities  and  the  relevant  estimated  parameters  for  the  system  types  were 
updated  with  the  calculated  values  from  the  optimization  routine.  The  system  types  that 
were  not  included  in  the  OFUEGO  solution  were  removed.  The  estimated  properties  can 
then  be  used  as  requirements  or  constraints  for  further  detailed  engineering  analysis. 


Results 

The  DISCO  methodology  proved  capable  at  searching  a  complex  design  space 
with  heterogeneous  system  types.  Importantly,  it  was  able  to  find  a  feasible  cost- 
effective  constellation  as  good  as,  or  better  than,  previous  fire  detection  constellation 
designs.  A  comparison  of  conceptual  design  results  for  the  Optimized  FUEGO 
(OFUEGO)  and  reference  ESA  FUEGO  concepts  are  compared  against  the  requirements 
in  Table  3. 

The  ESA  FUEGO  program  constellation  represents  a  traditional  system  trade 
study.  The  ESA  FUEGO  concept  design  assumed  the  re-use  of  the  sensors  flown  on  the 
BIRD  satellite.  The  ESA  FUEGO  program  found  that  a  constellation  of  12  satellites  in  a 
direct  Walker  3/4  constellation  at  700km  altitude  and  47.5°  inclination  orbit  would  meet 
system  requirements.  However,  the  infrared  sensor  flown  on  the  BIRD  satellite  was 
designed  for  a  different  mission.  Specifically,  it  was  designed  to  detect  fires  that  were 
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4m  x  4m  at  1 100K  temperatures.  It  also  had  additional  payloads  for  meeting  secondary 
mission  objectives. 

Consequently,  the  FUEGO  satellite  concept  was  larger  and  potentially  more 
expensive  than  required  to  detect  50m“  fires  which  were  the  FUEGO  requirements.  The 
ESA  FUEGO  program  estimated  that  the  LCC  for  a  7  year  mission  would  be  $203 
million  Euro  (~  $278  million  US  dollars).  This  total  system  cost  included  3  Rockot 
launch  vehicles,  one  for  each  plane.  Using  the  Small  Satellite  Cost  Model  (SSCM),  the 
average  cost  of  a  Rockot  launch  vehicle,  an  estimated  $25M  for  satellite  operations,  and 
an  estimated  $25M  for  ground  system  development  the  estimated  LCC  for  FUEGO  is 
$223M  in  FY  2010  dollars. 


Table  3.  OFUEGO  results  summary 


FUEGO 

ESA  FUEGO 

OFUEGO 

Requirements 

Reference 

Solution 

Target  Characteristics 

Developing  fires 

Developing  fires 

Developing  fires 

Coverage  Area 

Critical  regions 
(37-46°  N/S) 

Critical  regions 
(37-46°  N/S) 

Critical  regions 
(37-46°  N/S) 

Min  Detectable  Fire 

50m2 1100K  fire 
(SNR=100) 

20m2  HOOK  fire 
(SNR=100) 

50m2 1100K  fire 
(SNR=100) 

Probability  of  Detection,  Pd 

Pd>  95%  within  25  min 

Pd>  95%  within  25 
min 

Pd  >  95%  within  25  min 

Revisit  Interval 

Avg  <15  min 

Max  <25  min 

Avg  =15  min 

Max  =25  min 

Avg  =15  min 

Max  =25  min 

Mapping  accuracy 

<  500m 

<  500m 

<  500m 

Fire  Detection  Timeliness 

<  30  min 

<  30  min 

<  30  min 

LCC  Estimate 

$223M  (SSCM) 

$141M  (SSCM) 

Interestingly,  the  DISCO  methodology  identified  a  very  similar  conceptual  design 
to  FUEGO.  Both  the  FUEGO  and  OFUEGO  concept  designs  employ  a  significantly 
smaller  fire  detection  sensor  than  the  design  identified  in  the  SMAD  textbook.  However, 
the  MBCD  methodology  resulted  in  an  optimized  design  with  an  estimated  LCC  that  was 
$82  million  less  than  the  previously  identified  ESA  FUEGO  reference  architecture.  The 


50 


FUEGO  conceptual  design  and  the  OFUEGO  conceptual  designs  both  meet  the  identified 
system  requirements.  However  by  employing  a  higher  orbit  with  a  smaller  optical 
system  the  OFUEGO  design  represents  a  smaller  less  expensive  satellite  with  coverage 
perfonnance  equivalent  to  the  ESA  FUEGO  reference  design  [26]. 

Discussion 

Three  immediate  results  were  assessed  from  the  research  presented  in  this  paper. 
First,  the  DISCO  methodology  and  MBCD  framework  proved  applicable  to  the  example 
fire  detection  multi-orbit  disaggregation  problem.  Secondly,  the  DISCO  methodology 
was  able  to  effectively  search  a  vast  design  space  of  heterogeneous  system  types,  their 
quantity,  continuous  payload/sensor  parameters  and  constellation  orbit  parameters.  It 
was  able  to  identify  candidate  near-optimal  architectures  that  were  very  similar  to,  and 
more  cost  effective,  than  previously  identified  designs.  Third,  the  DISCO  methodology 
did  not  identify  mixed  or  heterogeneous  system  types  as  the  near  optimal  solution  for  this 
problem. 

The  presented  work  represents  a  new  approach  to  the  optimization  of  conceptual 
space  system  architectures,  especially  as  related  to  multi-orbit  heterogeneous 
disaggregated  space  systems.  DISCO  applies  many  of  the  principles  described  in  Azad 
Madni’s  article  [30]  on  generating  novel  system  architectures.  Such  principles  include: 
systems  thinking,  situational  decision  modeling,  temporal  analysis,  analogical  reasoning, 
sensitivity  analysis,  and  option  management  in  a  computer-aided  conceptual  design 
approach. 
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A  fire  detection  problem  demonstrated  the  application  of  this  methodology  to  a 
multi-orbit/multi-system  type  single  function  disaggregation  problem.  The  research  in 
this  paper  also  demonstrated  a  MATLAB  genetic  algorithm  routine  with  an  STK  orbital 
dynamics  model.  This  integrated  approach  was  capable  of  evaluating  thousands  of 
iterations,  tens  of  thousands  of  potential  solutions  and  the  corresponding  millions  of 
functional  evaluations  over  the  course  of  hundreds  of  hours.  Similar  diversity  of  solution 
space  evaluations  using  traditional  or  concurrent  design  techniques  would  take  months  to 
years.  Automating  this  process  was  essential. 

With  traditional  approaches,  “there  is  no  guarantee  that  a  system-level  focus  will 
be  taken,  and  often  the  final  design  chosen  achieves  only  feasibility,  instead  of  near 
optimality”  (Mosher  1996).  Initial  results  indicate  that  the  DISCO  methodology  may 
benefit  the  conceptual  design  of  potential  disaggregated  space  systems  by  codifying  that 
system-level  focus. 
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III.  Multi-function  Optimization  and  Sensitivity  Analysis  Methods 


Introduction 

Space-based  earth  observation  satellites  are  critical  to  global  weather  observation 
and  forecasting  capabilities.  Space-based  weather  satellites  provide  data  used  to  help 
save  lives  and  minimize  damage  caused  by  severe  weather  and  improve  weather 
forecasting  capabilities  [31].  Defense  weather  satellites  provide  environmental  data  used 
for  planning  and  conducting  military  operations  worldwide  [32].  The  Defense 
Meteorological  Satellite  Program  (DMSP)  satellites  have  been  providing  weather  data  to 
the  defense  community  since  the  1960’s.  The  National  Oceanic  and  Atmospheric 
Administration  (NOAA)  in  partnership  with  the  National  Aeronautics  and  Space 
Administration  (NASA)  has  also  developed  and  fielded  Polar  Operational  Environmental 
Satellites  (POES)  and  Geostationary  Operational  Environmental  Satellites  (GOES)  since 
the  1960’s  and  1970’s  respectively  supporting  the  civil  weather  users.  In  1995,  a  joint 
U.S.  Department  of  Defense  (DoD)  and  NOAA  program  dubbed  National  Polar-Orbiting 
Operational  Environmental  Satellite  System  (NPOESS)  was  established  with  the  intent  of 
consolidating  the  DMSP  and  POES  programs.  The  NPOESS  program  was  cancelled  in 
2010  due  technical  and  programmatic  difficulties  including  significant  cost  growth  and 
schedule  delays.  In  response  NOAA,  partnering  with  NASA,  established  the  Joint  Polar 
Satellite  System  (JPSS)  and  the  Department  of  Defense  established  the  Defense  Weather 
Satellite  System  (DWSS).  The  U.S.  Congress  instructed  the  DoD  to  tenninate  the  DWSS 
program  in  2012.  The  DoD  has  since  launched  its  next  to  last  DMSP  satellite  and  is 
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assessing  options  for  developing  the  next-generation  Weather  System  Follow-on  (WSF) 
[33]. 

The  Weather  System  Follow-on  (WSF)  program  is  currently  planned  to  be 
developed  as  a  disaggregated  system  of  systems.  According  to  US  Air  Force  budget 
documents  “WSF  will  take  a  disaggregated  system-of-systems  approach  to  meet  specific 
Department  of  Defense  needs  while  leveraging  near-tenn  civilian  and  international 
partnerships”  [34].  Initial  WSF  architecture  and  technology  risk-reduction  studies  are 
underway.  These  studies  are  assessing  visible  and  infrared  sensor  designs,  microwave 
radiometer  designs,  spacecraft  bus  designs,  and  architecture  alternatives  [35].  This  paper 
will  apply  the  Disaggregated  Integral  System  Concept  Optimization  (DISCO) 
methodology  to  the  WSF  conceptual  architecture  problem.  The  applicability  of  the 
DISCO  methodology  to  this  multi-function  multi-orbit  disaggregation  problem  will  be 
assessed.  Additionally,  a  Disaggregated  Weather  System  Follow-on  (DWSF)  conceptual 
design  will  be  presented  as  the  near  optimal  solution,  and  compared  to  a  large  multi¬ 
function  satellite  reference  design  analogous  to  the  DWSS  concept. 

Five  distinct  disaggregation  concepts  have  been  identified  in  the  past.  These 
disaggregation  concepts  include  fractionation,  functional  disaggregation,  multi-orbit 
disaggregation,  hosted  payloads,  and  multi-domain  disaggregation  [36].  Fractionation  is 
the  distribution  of  spacecraft  sub-system  functionality  among  networked  spacecraft. 
Functional  disaggregation  is  the  distribution  of  mission  functions  among  spacecraft  in  the 
same  orbital  regime.  Multi-orbit  disaggregation  is  the  distribution  of  a  single  mission 
function  across  different  orbits.  Hosted  payload  disaggregation  distributes  mission 
functionality  onto  a  separate  government  or  commercial  satellite.  Multi-domain 
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disaggregation  distributes  mission  functionally  across  domains  such  as  space,  air,  ground, 
and  or  cyber.  The  WSF  problem  is  most  naturally  described  as  multi-function/multi- 
orbit  disaggregation  problem  where  functionality  such  as  imagery  and  sea  surface  wind 
estimation  are  distributed  among  small  functionally-cohesive  spacecraft,  distributed 
across  distinct  orbital  planes  optimized  for  the  corresponding  mission  functions.  In  other 
words,  the  goal  of  the  optimization  routine  is  to  place  the  right  satellite,  at  the  right  time, 
in  the  right  place  to  minimize  life  cycle  costs.  Hosted  payload  types  could  also  be  added 
to  the  WSF  conceptual  design  space  as  constrained  system  variants  but  due  to  the  lack  of 
pedigreed  cost  models  and  the  additional  complexity  added  to  the  optimization 
formulation  hosted  payloads  are  planned  to  be  addressed  in  future  research. 

Significant  space-system  optimization  research  has  been  conducted  previously 
with  regards  to  distributed  satellites.  Matossian  pioneered  the  optimization  of  distributed 
space  system  architectures  as  compared  with  the  optimization  of  space  system  component 
or  parameter  optimization.  He  applied  a  space  system  optimization  method  to  identify 
near-optimal  Earth  Observation  System  (EOS)  constellations  by  clustering  existing 
sensors  at  assumed  orbit  height  and  assessing  the  return  via  subjective  perfonnance 
assessments  [37].  Shaw  et.al  developed  the  Generalized  Infonnation  Network  Analysis 
(GINA)  methodology  for  identifying  and  assessing  potential  distributed  satellite  system 
constellations  by  modeling  space  systems  as  networks  [19].  The  GINA  methodology  was 
intended  for  the  identification  and  assessment  of  distributed  satellite  system  conceptual 
architectures  but  did  not  address  the  optimization  of  these  architectures.  Jilla  et  al. 
expanded  Shaw’s  dissertation  research  by  integrating  a  space  system  optimization 
methodology  with  the  GINA  methodology.  The  combined  identification,  assessment, 
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and  optimization  methodology  was  termed  the  multi-objective,  multidisciplinary  design 
optimization  systems  architecting  (MMDOSA)  methodology  [18].  The  MMDOSA 
methodology  was  applied  to  the  optimization  of  communication,  radar  earth  observation, 
and  terrestrial  planet  finding  satellite  constellation  conceptual  designs  [38].  The 
MMDOSA  methodology  was  limited  to  homogeneous  system  types  and  single  function 
performance  assessments.  Additionally,  the  MMDOSA  methodology  did  not  incorporate 
system  constraints  or  real-coded  vs.  integer  parameter  optimization.  Selva  et.  al  expanded 
Matossian’s  work  by  evaluating  EOS  clustering  of  given  sensors  with  non-linear 
assumptions  and  expanded  rule-based  assessment  of  architectures. 

These  foundational  methodologies  are  insufficient  in  assessing  the  multi- 
function/multi-orbit  WSF  space  system  optimization  problem  for  three  primary  reasons. 
First  the  optimization  techniques  identified  by  Matossian  and  Selva  attempt  to  identify 
near-optimal  architectures  based  upon  the  clustering  of  existing  instruments  and  do  not 
attempt  to  optimize  sensor/instrument  parameters  to  mission  needs.  If  the  conceptual 
designs  of  the  existing  sensors  are  not  optimized  for  the  specific  mission  then  solutions 
are  identified  that  may  be  far  from  optimal.  Secondly,  the  GINA  and  MMDOSA 
“distributed”  spacecraft  conceptual  design  methodologies  model  satellite  constellations  of 
homogeneous  spacecraft.  The  GINA  methodology  does  not  provide  a  method  for  space 
system  conceptual  design  optimization.  The  MMDOSA  methodology  does  not  enable  the 
optimization  of  heterogeneous  satellite  constellations  associated  with  the  multi- 
function/multi-orbit  WSF  optimization  problem.  Third  none  of  the  previous  distributed 
satellite  conceptual  spacecraft  design  methodologies  address  techniques  that  enables 
model,  physics,  or  requirement  related  constraints.  Consequently,  problems  such  as  the 
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Weather  System  Follow-on  require  a  methodology  that  can  address  the  unique  aspects  of 
heterogeneous  system  solutions  associated  with  multi-function/multi-orbit 
disaggregation. 

Methodology 

A  general  methodology  for  the  integrated  analysis  and  optimization  of  disaggregated 
system  concepts  was  developed  and  described  in  [39].  An  overview  of  this  general 
methodology  is  presented  in  Figure  12  and  the  methodology  process  steps  are  discussed 
in  sections  0,  0,  and  0  that  follow. 


Figure  12.  DISCO  methodology  overview. 


DISCO  is  an  integrated  methodology  intended  to  assist  systems  engineers  in  optimizing 
conceptual  system  architecture  solutions.  Candidate  logical  architectures  are  developed 
and  documented  in  an  architecture  reference  model  based  upon  stakeholder  needs  and 
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system  requirements.  An  optimization  routine,  using  mixed  variable  optimization 
techniques,  evaluates  performance  and  dynamics  measures  while  attempting  to  minimize 
objective  functions  associated  with  cost,  schedule,  perfonnance,  risk,  and  quality  as 
applicable. 

The  general  steps  that  comprise  the  DISCO  methodology  are: 

1 .  Develop  reference  architecture 

2.  Develop  integrated  optimization  and  assessment  models 

3.  Evaluate  results  and  update  reference  architecture 

The  DISCO  methodology  was  applied  to  a  single-function  (fire-detection)  multi-orbit 
disaggregation  problem  in  [39].  The  conceptual  architectures  for  many  practical  space- 
based  applications,  such  as  weather,  are  required  to  perfonn  multiple  missions  and 
functions.  Several  techniques  used  within  the  DISCO  methodology  must  be  tailored  for 
the  optimization  of  multi-function/multi-orbit  disaggregation  problems.  These  tailored 
techniques  are  highlighted  in  the  following  paragraphs  using  a  conceptual  DWSF  system 
as  an  example. 

Develop  Reference  Architecture 

The  conceptual  reference  architecture  is  an  integrated  model  that  summarizes  the 
mission  operations  concept  (including  operator  stakeholder  needs,  mission  requirements, 
and  constraints),  Measures  of  Effectiveness  (MOEs),  draft  system  requirements  and 
constraints,  a  logical  architecture,  and  a  mapping  of  the  logical  architecture  to  the 
logical/physical  node  architecture.  This  reference  architecture  should  ideally  be 
documented  in  a  systems  engineering  modeling  language  such  as  SysML  and  be 
developed  via  a  Model  Based  Systems  Engineering  (MBSE)  tool  using  an  MBSE 
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methodology  such  as  the  Object  Oriented  Systems  Engineering  Method  (OOSEM).  The 
conceptual  reference  architecture  should  be  only  as  detailed  as  necessary  to  identify  the 
potential  system  type  and  technology  concept  trades. 

Operations  Concept,  Stakeholder  Needs,  Mission  Requirements/Constraints,  MOEs, 

and  draft  system  requirements 

The  operations  concept  includes  “the  way  the  system  works  from  the  operator’s 
perspective”  including  needs,  goals,  and  characteristics  of  the  user  community  [13].  The 
operations  concept  as  referred  to  in  this  methodology  process  step  refers  to  MBSE 
products  rather  than  the  concept  of  operations  document.  The  MBSE  operations  concept 
should  identify  stakeholders,  stakeholder  organization,  and  stakeholder  needs  via  use 
cases  and  activity  models.  The  mission  requirements  (also  referred  to  as  mission 
objectives),  mission  constraints,  and  draft  system  requirements/constraints  should  be 
modeled  in  SysML  requirement  diagrams.  MOEs  are  the  “operational  measures  of 
success  that  are  closely  related  to  the  achievement  of  the  mission  or  operational  objective 
being  evaluated,  in  the  intended  operational  environment  under  a  specified  set  of 
conditions”  [13].  Principles  for  the  use  of  effectiveness  criteria  are  summarized  in  The 
Engineering  Design  of  Systems  and  applicably  include  using  “trade-offs  to  show  the 
customer  cost,  performance,  schedule,  and  risk  impacts  of  requirements  and  solution 
variations”  [40].  The  DISCO  methodology  assumes  that  system  affordability  and  system 
perfonnance  are  identified  MOEs.  Schedule  and  Risk  are  other  MOEs  that  are  typically 
assessed  through  value  modeling.  For  this  paper,  system  affordability  and  system 
perfonnance  are  identified  as  the  applicable  MOEs.  The  affordability  MOE  is  addressed 
by  structuring  the  optimization  formulation  to  search  for  minimum  estimated  cost 
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systems  capable  of  meeting  perfonnance  constraints.  For  the  WSF  example  the  system 
perfonnance  MOE  is  assessed  by  the  probability  of  detection  for  each  required  data 
collection  function  (imagery,  sea  wind  vectors,  sea  temperature,  soil  moisture,  and  space 
weather  data).  The  MOEs  should  ideally  be  captured  in  mission  level  parametric 
diagrams. 

Logical  Architecture,  Function/System  Traceability 

A  draft  logical  architecture  should  be  developed  according  to  pedigreed  Systems 
Engineering  methods  identified  in  [41].  The  logical  architecture  identifies  the  system 
functions  derived  from  the  mission  objectives.  The  interactions  between  these  functions 
will  likely  be  abstract  at  this  point  in  the  conceptual  design  process.  Potential  system 
types  are  identified  and  defined  in  a  block  definition  diagram.  An  example  block 
definition  diagram  for  the  WSF  application  is  shown  in  Figure  13. 

Develop  Integrated  Optimization  and  Assessment  Models 

An  integrated  optimization  and  assessment  model  is  developed  by  first 
detennining  the  optimization  formulation,  then  developing  assessment  models,  then 
developing  a  mixed  variable  optimization  software  routine  with  consistent  model  inputs 
and  outputs  (e.g.  design  variables,  constraint  equation,  linked  variables,  and  calculated 
constraint  functions). 

Optimization  Formulation 

The  general  DISCO  optimization  fonnulation  has  been  extended  to  cover  the 
multi-function/multi-orbit  disaggregation  case.  The  corresponding  extended  general 
DISCO  mathematical  optimization  formulation  is: 

Find  (xj ,yij)  for  i  —  1  to  nx  and  j  =  1  to  n2 
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Which  minimizes  the  function 


Til 


f(x,y)  =  Yjcfevx?ev  +  cj 
1=1 


prod^prod  _j_  cutil  xutil  _|_  Qsupt ^supt  _j_ 


[6] 


Subject  to  the  conditions 

Xu  <xt<  xiu 
y iji  ^  yy  ^  yiju 

(  Gik(x,y )  <  0  k  =  1  to  n3  if  i  =  1 
(Ga (a:, y)  <  0  /or  l  —  1  to  nA  if  i  ^  1 
9im(x>y )  —  0  /or  i  =  1 t0  ni  and  m  —  1  to  ns 

where: 

Xj0  =  {0,1}  /or  aH  t 
x  =  [x1;  x2, ... ,  integer 

y  —  [yi,y2,  ■■■yn2]r:  continuous 
cio,  ct  are  functions  of  x  and  y 

The  tenn  f(x,y)  is  the  optimization  objective  function  that  is  equivalent  to  the  estimated 
lifecycle  cost,  c  represents  the  vector  of  calculated  cost  coefficient  associated  with  the 
number  of  systems  of  type  i  and  the  corresponding  lifecycle  category.  The  vector  x 
represents  the  number  of  systems  of  type  i  associated  with  the  specific  life  cycle  stages 
(development,  production,  utilization/operation,  support  and  retirement).  The  terms  xiL, 


Xiu,  yijL,  yiju  represent  integer  lower  and  upper  bounds  and  continuous  upper  and  lower 
bounds  in  turn. 


The  primary  difference  for  multi-function  versus  multi-orbit  optimization 
fonnulations  is  related  to  the  MOE  constraints.  The  MOE  constraint  functions  are 
represented  by  the  Gik(x,y )  terms.  The  MOE  constraints  should  be  measured  at  the 
family  of  systems  level.  The  combination  of  satellites  must  meet  the  MOE  constraints 
for  the  entire  set  of  required  mission  functions.  For  the  WSF  example  there  are  three 
possibilities  associated  with  meeting  MOE  constraints.  First,  a  constellation  of  multi¬ 
function  satellites  could  meet  the  required  collection  capability.  Secondly  a  constellation 
of  disaggregated  small  satellites  could  provide  the  required  mission  functionality.  Finally, 
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a  combination  or  mix  of  multi-function  and  disaggregated  small  satellites  could  provide 
the  full  suite  of  required  functionality.  The  optimization  fonnulation  is  setup  to  account 
for  this  grouping  of  MOE  constraints.  Finally,  the  tfimO*,}')  —  0  term  represents  model, 
perfonnance,  physical,  or  requirements  constraints  at  the  system,  subsystem,  or 
component  level. 

Assessment  Models 

Once  the  optimization  formulation  is  complete,  the  applicable  cost,  performance, 
and  dynamics  models  are  developed.  Numerous  models  could  be  used  to  assess  potential 
Disaggregated  Weather  System  Follow-on  (DWSF)  conceptual  architectures.  For 
disaggregated  space  systems  two  applicable  cost  models  are  identified.  The  Unmanned 
Space  Cost  Model  (USCM)  is  applicable  to  large  multi-function  satellites  and  the  Small 
Satellite  Cost  Model  (SSCM)  is  used  for  small  satellites.  The  latest  version  of  the  USCM 
only  models  estimated  communication  payload  development  and  production  costs. 
Consequently,  the  NASA  Instrument  Cost  Model  was  used  in  conjunction  with  the 
USCM  to  estimate  the  development  and  production  costs  of  payloads.  These  cost  models 
are  discussed  in  detail  in  [1]. 

Perfonnance  models  vary  significantly  depending  upon  mission  areas.  For  earth 
observation  missions  such  as  the  WSF  mission  the  primary  system  perfonnance  measures 
of  performance  can  typically  be  derived  to  instrument  sensitivity  requirements  such  as 
Signal  to  Noise  Ratio  (SNR)  or  Noise  Equivalent  Difference  Temperature  (NEDT)  at 
specified  spatial  or  spectral  sampling  intervals.  The  source  signal  is  commonly 
approximated  using  physics  based  equations  such  as  Planck’s  equation. 
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Dynamics  models  generally  fall  into  two  categories  for  space  systems:  analytical 
approximations  or  numerical  simulations.  Analytic  approximations  can  be  used  to 
estimate  area  coverage  rates  and  area  access  rates.  Numerical  simulations  can  be  used  to 
accurately  estimate  constellation  measures  of  perfonnance  such  as  revisit  rates,  percent 
coverage,  and  maximum  coverage  gap  times  for  example.  Previous  applications  of  the 
DISCO  methodology  have  demonstrated  the  use  of  analytic  coverage  and  revisit  rate 
approximations  [42]  and  numeric  simulation  derived  coverage  and  revisit  rate 
calculation  [39].  The  analytic  approximation  technique  enables  much  faster  optimization 
routines  but  does  not  account  for  effects  due  to  a  spherical  earth  or  satellite  overlap. 
Optimization  routines  based  upon  numeric  simulations  take  significantly  longer  to 
execute  but  enable  accurate  constellation  orbit  parameterization.  The  DWSF  application 
discussed  in  the  application  section  uses  analytical  approximation  techniques  to  identify 
approximate  solutions  and  then  numeric  simulations  to  finalize  the  orbit  design  and 
assess  the  identified  near  optimal  solutions  for  revisit  measures  of  performance. 

Integration  of  Optimization  Formulation  and  Assessment  Models 
The  optimization  algorithm  execution  function  acts  as  the  integration  routine 
between  the  optimization  formulation  and  the  assessment  models.  The  integration  of  the 
design  variables,  dependent  variables,  constraints,  assessment  module  inputs,  and  outputs 
can  be  challenging  for  disaggregated  space  system  optimization  problems.  SysML 
parametric  diagrams  can  be  used  to  aid  in  the  organization  of  this  step  by  identifying 
software  modules  and  their  associated  inputs  and  outputs.  For  the  WSF  example  the 
primary  software  modules  are  a  genetic  algorithm  execution  routine,  an  objective 
function  module,  a  constraint  function  module,  a  cost  model  module,  a  dynamics  module, 
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and  a  sensor  perfonnance  module  for  each  identified  sensor  type.  The  cost  estimation 
module  is  integrated  with  the  design  variables  based  upon  sizing  of  analogous  sensors. 
The  dynamics  module  calculates  coverage  or  revisit  constraints  based  upon  a  numeric 
dynamics  simulator  or  analytical  approximation  techniques.  The  WSF  example 
application  uses  analytical  approximations  to  determine  approximate  solutions  and  then  a 
numeric  simulation  is  used  to  finalize  the  orbital  design.  The  sensor  perfonnance  module 
inputs  sensor-related  design  variables  such  as  satellite  height,  sensor  view  angle,  and 
aperture  diameter  and  outputs  estimated  performance  metrics  such  as  SNR  or  NEDT. 

Evaluate  Sensitivity  of  Optimization  Results  and  Update  Conceptual  Reference 

architecture 

Once  the  integrated  optimization  is  executed,  the  results  are  assessed  prior  to 
convergence  on  a  proposed  conceptual  architecture  solution.  Potential  near-optimal 
solutions  should  be  assessed  for  accuracy,  fitness  over  identified  local  optimal  solutions, 
and  possibly  sensitivity  to  requirements  and  stochastic  parameters.  The  system  architect 
should  first  verify  the  accuracy  of  the  solution.  This  accuracy  assessment  should  ensure 
that  bounds  and  constraints  were  properly  modeled.  Secondly,  the  optimization  routine 
should  be  executed  across  numerous  trials,  as  heuristic  optimization  techniques  are  not 
guaranteed  to  provide  global  minimum  solutions.  If  numerous  optimization  routines  are 
executed  with  a  random  uniformly  distributed  initial  population  and  minimal  variations 
exist  in  the  solutions,  some  confidence  is  gained  in  the  solution  for  the  given  model 
assumptions.  Finally,  if  the  converged  solution  is  heavily  dependent  upon  the  impact  of 
variable  parameters,  a  sensitivity  analysis  should  be  perfonned  to  detennine  the  impact 
that  parameter  variations  have  on  the  results.  Once  adequate  analysis  of  the  results  is 
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complete,  the  design  variables  and  calculated  parameter  estimates  are  updated  in  the 
reference  architecture.  Newer  integrated  MBSE  tools  should  be  able  to  automate  this 
update.  An  example  of  the  updated  block  definition  diagram  for  the  DWSF  application  is 
shown  in  Figure  18. 

Application 

The  DoD  needs  a  cost-effective  responsive  follow-on  to  the  DMSP  program.  The 
Congressional  Budget  Office  (CBO)  conducted  a  study  in  2012  assessing  the  options  for 
modernizing  military  weather  satellites.  This  report  identified  options  for  a  WSF 
architecture  that  would  provide  space-based  data  to  cover  significant  gaps  in  the  future 
DoD  weather  enterprise  caused  by  the  cancellation  of  NPOESS  and  DWSS.  The  CBO 
report  proposed  three  potential  options  defined  by  the  inclusion  of  various  legacy  sensors 
on  a  single  defense  satellite  in  a  single  early  morning  orbit.  The  CBO  report  identified 
that  an  approach  based  upon  distributing  instruments  amongst  multiple  satellites  was 
possible.  Several  potential  advantages  of  this  multi-function,  multi-orbit  disaggregation 
were  identified,  including:  smaller,  simpler  easier  to  build  satellites,  greater  flexibility  in 
deploying  and  replacing  satellites,  and  greater  flexibility  to  place  sensors  in  orbits  in 
which  they  are  best  able  to  carry  out  their  mission.  The  CBO  report  stated  that  the 
“primary  disadvantage  of  the  distributed  approach  is  that  it  might  cost  more  than  the 
single-satellite  approach,  depending  on  the  specific  configuration  of  the  satellites”. 
However,  the  CBO  did  not  conduct  a  quantitative  analysis  of  this  “distributed”  option. 
This  paper  provides  this  missing  analysis,  by  applying  the  DISCO  methodology  to 
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determine  cost-effective  Disaggregated  Weather  Satellite  Follow-on  (DWSF)  options  and 
make  a  comparison  to  traditional  solutions  of  Large  Multi-Function  (LMF)  satellites. 

Weather  System  Follow-on  (WSF)  Reference  Architecture 
This  section  documents  the  WSF  conceptual  reference  architecture.  The 
reference  architecture  is  depicted  with  SysML  diagrams  that  identify  WSF  stakeholder 
needs,  mission  objectives,  measures  of  effectiveness,  initial  system  requirements,  a 
candidate  logical  and  physical  node  architecture,  and  a  draft  mapping  of  primary  system 
functions  to  the  candidate  logical  nodes.  The  Department  of  Defense  (DoD)  stakeholders 
need  a  space-based,  global,  cost-effective,  responsive,  weather  data  sensing  capability. 
The  mission  objectives  include  providing  functionality  for 

•  the  collection  of  cloud  imagery  and  characterization, 

•  theater  weather  imagery, 

•  sea  surface  wind  vectors  (speed  and  direction), 

•  sea  surface  temperature 

•  soil  moisture, 

•  and  space  weather  measurement  (ionospheric  density,  scintillation,  charged 
particles,  and  electric  field). 

The  measure  of  effectiveness  for  a  conceptual  WSF  system  was  Probability  of  Detection 
for  each  of  these  listed  objectives  under  given  conditions  (i.e.  clear  weather,  cloud-free 
weather,  or  all-weather).  The  system  requirements  were  derived  by  the  authors  through 
the  identification  of  potential  gaps  in  weather  data  provided  by  the  existing  DoD  systems 
such  as  DMSP  and  key  mission  requirements  previously  identified  in  the  National  Polar- 
orbiting  Operational  Satellite  System  (NPOESS)  Integrated  Operational  Requirements 
Document  version  2  (IORD-II).  Additionally,  specific  sensitivity  requirements  for  SNR 
and  NEDT  were  derived  by  comparing  consistent  instrument  sensitivity  requirements  and 
instrument  specification  provided  on  previously  developed  imagery  payloads  in  [43]  and 
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previously  developed  microwave  payloads  in  [44],  The  corresponding  system 
requirements  are  summarized  in  Table  4. 

The  cancellation  of  the  NPOESS  and  DWSS  programs  has  created  the  potential 
for  significant  gaps  in  DoD  weather  data  collection  capabilities.  These  potential  gaps  fall 
into  the  primary  areas  of  imagery  revisit,  sea  surface  wind  vector  and  surface  temperature 
measurement,  soil  moisture  content  measurement,  and  space  environmental  monitoring. 
The  collection  gaps  are  primarily  caused  by  the  cancellation  of  the  NPOESS  and  DWSS 
programs.  There  is  a  reduced  number  of  satellites  in  the  JPSS  constellation  versus  the 
planned  NPOESS  constellation  resulting  in  longer  revisits  for  all  weather  data 
collections.  The  JPSS  constellation  does  not  include  a  microwave  instrument  that  is  able 
to  detect  sea  surface  temperature  and  wind  vectors  or  soil  moisture  in  cloudy  conditions. 
Additionally,  the  JPSS  concept  does  not  include  space  environmental  monitoring 
instruments.  These  readily  identifiable  gaps  and  the  associated  requirements  from  the 
NPOESS  IORD-II  were  used  to  identify  system  requirements  critical  for  a  conceptual 
WSF  system.  The  identified  system  requirements  sourced  from  the  IORD-II  are 
summarized  in  Table  4  [45].  The  requirements  identified  in  Table  4  are  a  subset  of  the 
requirements  associated  with  56  Environmental  Data  Records  identified  in  the  IORD-II. 
The  measurement  bands  and  sensor  performance  SNR  and  NEDT  requirements  were 
obtained  from  references  [43,45]  and  [44], 
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Table  4.  WSF  system  requirements. 


Coverage 

area 

Resolution 

Refresh 

Timeliness 

Accuracy 

(mapping) 

Accuracy 

(measurement) 

Imagery 

Weather  imagery 

global 

.4  km  (nadir) 

.8  km  (edge) 

4  hours  (avg  revisit)* 

6  hours  (max  revisit) 

90  mins 

1km  (nadir) 

3km  (edge) 

SNR  119  (L=22)  (,64±  .05pm) 
NEDT  2.5  (T=270K)  |3.74±.38|im) 

Sea  Surface 

Wind  speed 
(Clear) 

global 

(ice-free) 

20km  (nadir) 

6  hours 

90  mins 

5  km 

2  m/sec  or  10%* 

NEDT  .7  (305K)  (19.3±.4  GHz) 

Wind  direction 
(Gear) 

global 

(ice-free) 

20km  (nadir) 

6  hours 

90  mins 

5  km 

20  degrees  (>5m/s) 

NEDT  .7  (305K)  (19.3±.4  GHz) 

Temperature 

(clear) 

global 

1  km  (nadir)* 

1.3  km  (edge) 

6  hours 

90  mins 

1  km  (nadir) 

1.3  km  (edge) 

uncertainty  .5  degreesC* 
NEDT=.396  |T=270K)  (3.7±.18pm) 

Temperature 
(all  Heather) 

global 

40  km(edge) 

6  hours 

90  mins 

5  km 

NEDT=.7(305K)  (19.3±.4  GHz) 

Soil  Moisture* 

Moisture  content 
(dear) 

global 

1  km  (nadir) 

4  km  (edge) 

8  hours 

90  mins 

1km 

5  km 

10%  uncertainty  (skin  layer  -.1cm) 
SNR119(L=22)(.64±.05pm) 

Moisture  content 
(cloudy) 

global 

40  km  (nadir) 

50  km  (edge) 

8  hours 

90  mins 

1km 

5  km 

20%  uncertainty  (skin  layer  -.1cm)* 
NEDT  .7  (305K)  (19.3±.4  GHz) 

Space  Environment 
Monitoring 

Ionospheric  density 
&  scintillation 

global 

100  km 

NA 

90  mins 

10s  cm-3  or  30% 

.1  (amplitude), .1  radians  (phase) 

Charged  Particles 
Electric  field 

LEO 

Local 

NA 

90  mins 

NA 

15%  (50  KeV  to  4  Mel') 

3  mV  per  meter  (0+/- 150  mVm'1) 

Note:  Key  Performance  Parameters  identified  in  the  NPOESS  IORD  are  identified  by  an 


Once  the  mission  needs/objective  and  system  requirements  are  established 
candidate  logical  architecture  options  capable  of  meeting  these  needs/objectives  and 
requirements  are  established  for  the  WSF  system.  The  potential  system  types  are 
identified  via  a  block  definition  diagram  displayed  in  Figure  13.  This  figure 
demonstrates  the  mix  between  previously  developed  systems  (such  as  the  candidate 
launch  vehicles)  and  logically  defined  systems  such  as  the  large  multifunction  and  small 
imaging  system.  The  parameters  for  the  previously  developed  systems  are  already 
specified.  The  parameters  for  the  logically  defined  systems  will  be  estimated  via 
optimization.  The  system  numbers  highlighted  in  Figure  13  are  associated  with  the 
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system  type  identifier  in  the  optimization  fonnulation.  The  association  between  blocks 
also  identifies  the  unknown  relationship  for  conceptual  systems.  For  example  the  space 
system  and  ground  system  is  identified  as  composition  (a  part  of)  relationship  with  the 
WSF  block  because  the  WSF  system  is  defined  by  the  space  system  and  ground  system 
blocks.  Alternatively,  the  generalization  relationship  is  used  between  the  satellite  type 
and  the  WSF  space  system  block  because  each  satellite  type  is  only  potentially  part  of  the 
WSF  space  system  concept  definition.  The  optimization  routine  will  identify  which 
satellite  types  are  included  in  the  definition  of  the  WSF  system  along  with  the  estimated 
parameters  for  each  system  type.  Likewise  the  potential  launch  vehicles  are  identified  as 
a  potential  generalization  of  the  WSF  mission  enterprise  until  specific  launch  vehicles  are 
chosen  as  part  of  the  mission  architecture. 
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Figure  13.  Example  Logical  Architecture  Decomposition. 

Once  the  potential  system  types  are  identified  in  the  reference  architecture  then 
mission  level  functions  are  identified  and  allocated  to  candidate  system  types.  This 
allocation  is  ideally  shown  in  a  SysML  activity  diagram.  The  functional  allocation 
depends  upon  the  system  type  identification.  For  the  WSF  application  two  potential 
allocations  are  possible.  First  all  of  the  system  functions  can  be  allocated  to  sensors  on  a 
large-multifunction  satellite.  Secondly,  mission  functions  can  be  allocated  to  small 
focused  function  satellites.  Combinations  of  these  allocations  are  possible  however  for 
simplicity  only  these  two  functional  allocation  strategies  were  assessed.  The  large 
satellite  WSF  functional  allocation  is  displayed  in  Figure  14. 
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act  |Package|  Operational  Domain  Model  [Operational  Domain  Model] 
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Figure  14.  Activity  diagram  depicting  WSF  large  spacecraft  functional  allocation. 


Alternatively,  the  system  function  allocation  for  an  example  disaggregated  system 
is  depicted  in  Figure  15.  The  mission  functions  are  allocated  to  separate  small  satellites 
that  contain  small  functionally- related  payloads.  The  functions  could  be  further 
disaggregated  among  single  function  satellites.  However,  the  functional  disaggregation 
summarized  here  was  chosen  based  upon  functions  that  are  provided  using  synergistic 
instrument/technology  types.  For  example  microwave  radiometers  have  been 
demonstrated  to  provide  ocean  wind  speed,  wind  direction,  surface  temperature,  and  soil 
moisture  with  similar  sensor  perfonnance  requirements.  Additionally,  the  small  visible 
imagery  sensor  and  small  mid-wave  infrared  (IR)  sensors  could  be  disaggregated  further 
to  separate  satellites.  However,  soil  moisture  algorithms  a  dependent  upon  precise  co¬ 
registration  of  visible  and  infrared  measurements  for  determining  soil  moisture  content  in 
clear  conditions  [46].  Consequently  the  decision  was  made  to  disaggregate  the  visible 
and  mid-wave  IR  sensors,  but  not  disaggregate  them  to  separate  satellites.  The  DISCO 
methodology  enables  a  trade  study  between  these  disaggregation  techniques  to  determine 
which  is  more  cost  effective.  The  allocation  of  mission  functions  to  logical  nodes 
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(conceptual  design  types)  completes  the  reference  architecture  step  and  enables  the 
subsequent  optimization  formulation  and  assessment  model  development. 


Figure  15.  Activity  diagram  depicting  WSF  small  spacecraft  functional  allocation 
Weather  System  Follow-on  (WSF)  Integrated  Optimization  and  Assessment  Models 
The  integrated  optimization  and  assessment  models  for  the  WSF  conceptual 
architecture  problems  consist  of  an  optimization  formulation  that  aims  to  minimize  cost 
subject  to  performance  constraints,  unmanned  (large)  and  small  satellite  cost  assessment 
models,  dynamics  coverage  models,  sensor  performance  models,  and  a  genetic  algorithm 
global  optimization  routine  that  integrates  the  optimization  model  with  the  assessment 
models. 

Optimization  formulation 

The  optimization  formulation  for  a  disaggregated  WSF  conceptual  design 
problem  is  consistent  with  the  general  multi-function  multi-orbit  optimization 
formulation  presented  in  the  methodology  section  of  this  paper  (Equation  6).  It  is 
assumed  that  the  greatest  value  system  is  the  minimum  estimated  life  cycle  cost  system 
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that  meets  threshold  requirements.  Consequently  the  objective  function  is  defined  for 
WSF  as: 


n  i 


f(x,y) 


I 


cfvxfv  +  cYodxYod  +  c\ltilxYil  +  c.uptxYPt  +  crietxi 


[7] 


i=  1 

where  the  estimated  satellite  development  cost  coefficient  (cfev)  and  production  cost 
coefficient  ( c ?r od )  are  calculated  using  the  associated  satellite  cost  models  discussed  in 
the  subsequent  section  of  this  paper.  The  development  costs  for  launch  vehicles  are 
assumed  to  be  zero  because  previously  developed  launch  systems  are  expected  to  be  used 
and  the  production  costs  for  launch  vehicles  are  assumed  to  be  equal  to  the  average 
launch  vehicle  costs  provided  in  Table  1 1-23  of  [1]  times  the  number  of  launch  vehicles 
required.  The  development  cost  for  the  ground  system  is  assumed  $1.2  Billion  for  the 
system  integration  and  data  processing  software  development  derived  from  the  cost 
estimates  provided  in  [33].  Satellite  operations  and  data  dissemination  for  current 
military  weather  satellites  are  performed  by  the  NOAA  Environmental  Satellite 
Operations  Control  Center  (ESOCC)  and  National  Environmental  Satellite  Data  and 
Information  Service  (NESDIS)  systems.  It  is  assumed  that  this  operational  relationship 
will  remain  and  thus  the  development  and  production  costs  associated  with  the  satellite 
operations  and  data  dissemination  components  and  facilities  were  assumed  zero  ($0). 

The  estimated  utilization  cost  coefficient  includes  the  cost  to  operate  the  WSF 

constellation.  The  Fiscal  Year  2014  presidential  budget  submission  includes  a  budget  of 
$50  Million  per  year  to  operate  all  NOAA  environmental  satellites,  including  POES, 
GOES,  and  JPSS  [31].  Accordingly,  a  conservative  assumption  was  made  that  the  cost  to 
operate  the  constellation  of  WSF  satellites  would  be  at  most  $50M  per  year.  The  WSF 
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life  cycle  costs  were  assessed  for  18  years  assuming  an  initial  capability  in  2020  and 
extended  operations  through  2037.  Additionally,  it  is  assumed  that  operations  costs  are 
primarily  fixed  and  not  highly  dependent  upon  the  number  of  supported  satellites. 
Anecdotally  the  authors  personal  knowledge  confirms  that  the  operations  scale  for  large 
constellations  such  as  IRIDIUM,  GPS,  and  Planet  Labs  Flock  are  on  the  same  scale,  if 
not  smaller  that  small  constellations  of  large  multi-function  satellite  systems  such  as  the 
Space  Based  Infrared  System  (SBIRS)  or  Advanced  Extremely  High  Frequency  (AEHF) 
system.  Publically  releasable  cost  data  justifying  this  assumption  was  not  readily 
available  at  the  time  of  this  paper  submission.  The  estimated  cost  to  support  a  system 
(csupt)  is  assumed  to  include  the  cost  to  produce  replacement  satellites  and  their 
associated  launch  vehicles  (creplace)  and  the  cost  to  sustain  the  system  (csust).  Thus  the 
support  cost  coefficient  can  be  calculated  using  the  following  equation, c^upt  — 


replace  ,  sust  i  replace  prod  , mission  duration A  ,  .  .  , 

c-  +  cL  , where  c-  =  c[  *  ( - ),  and  t replace  is  the  assumed 

satellite  replacement  time.  The  estimated  cost  to  replace  a  ground  system  is  assumed  to 
be  zero  because  a  ground  system  will  be  sustained  rather  than  replaced  during  the  mission 
duration.  The  estimated  cost  to  sustain  a  satellite  is  assumed  to  be  zero  because  on-orbit 
servicing  is  assumed  to  be  infeasible  and  thus  a  satellite  will  be  replaced  versus  sustained. 
The  fixed  yearly  estimated  ground  system  sustainment  costs  were  assumed  to  be  $22.2 
Million  per  year  based  upon  derivations  from  the  provided  cost  estimates  in  [33].  The 
time  to  replace  as  small  satellite  was  assumed  to  be  6  years  and  the  time  to  replace  a  large 
multi-function  satellite  was  assumed  to  be  9  years.  The  assumed  6  year  replacement  time 
for  a  small  satellite  was  based  upon  a  case  study  from  small  satellite  developer  Surrey 
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Satellite  Technologies  LTD  (SSTL)  that  showed  “an  average  Mean  Time  To  Failure 
(MTTF)  for  their  satellites  of  6.4  year,  yet  the  average  design  life  was  only  2.1  years”  [1]. 
The  assumed  9  year  replacement  time  for  a  large  multi-function  satellite  was  based  upon 
the  9  year  satellite  replacement  time  assumed  in  [33].  Thus  the  estimated  cost  to  support 
(csupt)  the  WSF  system  for  the  planned  18  year  mission  duration  from  2020  to  2037  would 
include  the  cost  to  replace  and  launch  each  small  satellite  constellation  twice  and  each 
large  multi-function  satellite  constellation  once  plus  a  total  of  $400  Million  for  ground 
system  sustainment  over  the  18  year  mission  life.  This  simplified  technique  for 
detennining  sustainment  costs  does  not  take  into  account  the  relatively  large  capability 
loss  and  associated  risk  related  to  a  large  multi-function  satellite  failure  relative  to  a  small 
satellite  failure.  Further  research  is  planned  on  techniques  to  assess  the  impact  of 
stochastic  failure  rates  on  disaggregated  system  optimization.  Once  the  objective 
function  formulation  is  established  the  next  step  in  developing  the  optimization 
formulation  is  establishing  the  design  variables. 

The  design  vector  for  the  WSF  optimization  problems  consists  of  variables  for  binary 
development  system  inclusion,  satellite  planes,  satellites  per  plane,  satellite  orbital  height, 
sensor  aperture  diameter,  sensor  view  angle,  max  vertical  cell  size,  number  of  launch 
vehicles.  These  design  variables  along  with  their  corresponding  symbols  and  associated 
applicable  system  types  are  summarized  in  Appendix  B  of  this  article. 
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Table  5.  WSF  design  variable  summary 


Design  vector  variable 

symbol 

Applicable  systems 

Variable  type 

Bounds 

Lower  Limit-HL 

Units 

Uooer->UL 

Development  system  in  architecture 

X*" 

i=l-9 

binary 

LL=0  UL=1 

(#) 

number  of  satellite  planes 

^  planes 

i=l-4 

integer 

LL=1  UL=10 

(#) 

number  of  satellites  per  plane 

nspp 

1=1-4 

Integer 

LL=1  UL=10 

(if) 

Satellite  orbital  height 

h;at 

1=1-5 

Real 

LL=200  UL=varies 

(km) 

sensor  aperture  diameter 

Da 

1=1-4 

Real 

Cost  model  dependent 

(m) 

sensor  view  angle 

^sensor 

i=l-4 

Real 

Geometry  dependent 

(degs) 

horizontal  sample  interval  at  edge  of  service 

HSIeos 

i=l-3 

Real 

Requirement  dependent 

(m) 

number  of  launch  vehicles 

nlv 

i=5-9 

Integer 

LL=0  UL=10 

(#) 

The  objective  function  value  varies  indirectly  based  upon  the  identified  design  variables 
via  dependent  variable  equations.  For  example  the  estimated  development  cost  of  a 
system  is  calculated  by  multiplying  the  development  cost  coefficient  (cdev)  by  the 
development  system  architecture  inclusion  variable  (xdev).  The  development  cost 
coefficient  (cdev)  for  satellite  system  types  is  indirectly  related  to  the  Da,  0sensor,  and  HSIeos 
through  mass,  power,  and  data  rate  calculations  discussed  in  the  appendices.  The 
estimated  satellite  system  production  costs  are  detennined  by  multiplying  the  estimated 
production  cost  coefficient  (cprod)  by  the  number  of  production  satellites  (xprod).  The 
production  cost  coefficient  (cprod)  for  satellite  system  types  is  also  indirectly  related  to  the 
Da,  9 sensor?  and  HSIeos  through  mass,  power,  and  data  rate  calculations  discussed  in  the 
appendices.  The  number  of  production  satellites  (xprod)  is  calculated  using  the  equation 
xprod  _  xdev  *  n^lanes  *  ns pp  for  i=l  to  4.  The  cost  per  production  launch  vehicle  is 
assumed  to  be  the  average  cost  as  described  in  the  preceding  section  and  the  number  of 
production  launch  vehicles  is  equal  to  niv  such  that  xfrod  =  niv  for  i=5  to  9.  Once  the 
WSF  optimization  formulation  design  variables  are  identified  the  next  step  is  to  identify 
the  optimization  constraints.  The  constraints  for  the  WSF  system  are  dependent  upon  the 
system  type  and  the  perfonnance  requirements,  a  summary  identified  in  Table  6. 
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Table  6.  WSF  constraint  summary 


Variable 

Symbol 

Applicable  system 

Constraint 

unid 

Probability  of  detection 

Pd 

i=l,  {2,3,4} 

>99 

% 

Probability  of  signal  detection 

Ps 

i=l-4 

>99 

% 

Probability  of  coverage 

Pc 

i=l-4 

>99 

% 

Satellite  mass 

msat 

H-4 

<=/>=  cost  modellimits 

kg 

Payload  mass 

Mpayload 

H-4 

<=/>=  cost  modellimits 

kg 

Payload  power 

P  payload 

H-4 

<=/>=  cost  modellimits 

W 

Payload  data  rate 

DRpayload 

H-4 

<=/>=  cost  modellimits 

kbps 

sensorview  angle 

^sensor 

H-4 

>  Instantaneous  Field  of  View  (IFOV) 

radial 

Earth  Central  Angle 

ECA 

H-4 

<  Earth  angular  radius 

radial 

Elevation  angle 

e 

H-3 

>  .35  (min  geometric  elevation  angle) 

radial 

horizontal  sample  interval  at  edge  of  service 

HSIeos 

i= 1-3 

>  diffraction  limited  ground  sample  distance 

m 

vertical  sample  interval  at  edge  of  service 

VSUos 

H-3 

>  diffraction  limited  ground  sample  distance 

m 

horizontal  cell  size  at  nadir 

HCSnacjjr 

1=1,2 

<maximum  required  cell  size  atnadir 

m 

verticalcell  size  atnadir 

VCSna(ijer 

i=l,2 

<maximum  required  cell  size  atnadir 

m 

horizontal  cell  size  at  edge  of  service 

HCSeos 

i= 1-3 

<maximum  required  cell  size 

m 

verticalcell  size  at  edge  of  service 

VC  Seos 

H-3 

<maximum  required  cell  size 

m 

total  number  of  launch  vehicles 

Niv 

i=5-9 

>totalnumberof  satellite  planes 

# 

totallift  capacity 

LC 

i=5-9 

>totalmass  of  satellites 

kg 

The  mission  level  constraint  is  identified  by  the  MOE  probability  of  detection 
(Pd).  Probability  of  detection  is  estimated  by  multiplying  the  probability  of  signal 
detection  (Ps)  by  the  probability  of  coverage  (Pc).  The  Pd  constraint  is  assumed  to  be 
99%  for  all  cases.  The  probability  of  signal  detection  is  assumed  to  be  100%  if  the 
minimum  performance  constraints  (i.e.  SNR  or  NEDT)  are  met.  The  probability  of 
coverage  for  the  associated  refresh  time  is  estimated  as  the  percent  coverage  for  the 
associated  coverage  time.  The  MOE  constraint  is  calculated  as  one  value  for  a  large 
multifunction  satellite  or  the  aggregate  of  the  MOE  constraints  for  all  of  the  small 
satellites.  The  space  vehicle  system  constraints  include  minimum  and  maximum  mass 
limits  identified  by  the  corresponding  cost  model.  Payloads  are  also  constrained  by 
minimum/maximum  mass,  power,  and  data  rate  limits  associated  with  the  NASA 
Instrument  Cost  Model  or  mass  limits  for  the  small  satellite  cost  model.  The  sensors  are 
constrained  by  a  maximum  earth  central  angle  associated  with  a  view  angle  greater  than 
the  maximum  earth  central  angle.  Sensors  are  also  constrained  by  a  minimum  elevation 
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beyond  which  the  vertical  component  of  an  image  cell  causes  difficult  to  correct  imagery 
and  measurement  errors.  Sensors  are  constrained  by  the  minimum  horizontal/vertical 
sample  interval  determined  by  the  diffraction  limit.  Sensors  are  also  constrained  by  the 
max  cell  size  at  nadir  and  edge  of  service  (EOS)  defined  by  the  system  requirements. 

The  sensor  sizing  is  also  constrained  by  a  minimum  and  maximum  aperture  ratio.  There 
are  two  primary  launch  vehicle  constraints.  First  the  total  lift  capacity  of  the  launch 
vehicle  must  be  greater  than  the  total  mass  of  the  spacecraft.  The  lift  capacity  is  currently 
assumed  as  a  set  mass  limit  for  sun-synchronous  orbit  for  a  low  earth  orbit.  The  model  is 
currently  being  updated  to  model  maximum  lift  capacity  for  a  sun-synchronous  orbit  via 
a  non-linear  regression  of  the  lift  capacity  vs.  orbital  height  (h)  from  the  launch  vehicle 
users  guides.  Additionally,  the  total  number  of  launch  vehicles  must  be  greater  than  the 
total  number  of  satellite  planes  in  the  architecture.  The  launch  vehicle  constraint 
formulation  is  based  upon  techniques  identified  in  appendix  B  of  [38].  The  complete 
optimization  formulation  is  presented  in  appendix  B  of  this  article.  Once  the 
optimization  formulation  is  fully  identified  the  appropriate  assessment  models  are 
developed. 

Assessment  Models 

The  DISCO  methodology  uses  the  combination  of  integrated  parametric  cost 
models  and  physics/geometry  based  dynamics/performance  models.  The  estimated 
satellite  development  cost  and  production  costs  are  calculated  using  existing  satellite  cost 
models  including  the  Unmanned  Satellite  Cost  Model  (USCM),  the  NASA  Instrument 
Cost  Model  (NICM),  and  the  Small  Satellite  Cost  Model  (SSCM).  Estimated  satellite 
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development  and  production  costs  are  calculated  according  to  the  methods  discussed  in 
[!]•  Satellite  development  costs  are  calculated  according  to  the  following  equation: 

rde v  _  ndev  t  r'dev  i  r>dev  t  r>dev  i  rdev  i 

L,sat  '-'bus  '  upZ  '  Wa&t  '  u program  '  u age  l 

where  the  estimated  development  cost  for  a  satellite  is  denoted  Cfat  ■  The  production 
costs  are  calculated  using  the  following  equation: 

P prod  _  ^.prod  .  ^ prod  .  ^ prod  .  ^ ,prod  .  ^ prod  , 

Lsat  ~  Lbus  Lpl  -r  Lia&t  L program  LLOOS  l 

The  definitions,  assumptions,  and  cost  estimating  relationships  for  each  of  these  cost 
components  are  detailed  in  appendix  B  of  this  articleO. 

Dynamics  Assessment  Model 

Now  that  the  top  level  cost  estimation  models  are  documented  than  the  top-level 
dynamics  models  are  established.  The  primary  dynamics  model  used  for  the  WSF 
conceptual  design  is  based  upon  Probability  of  coverage  (Pc)  equation  related  to  the 
system  refresh  requirements  as  derived  from  chapter  10  of  reference  [1].  For  this  paper 
Pc  is  estimated  using  analytical  estimation  techniques  to  enable  conceptual  design  space 
analysis.  A  simulation  approach  to  more  accurately  estimate  Pc  or  revisit  rates  directly  is 
discussed  in  [39].  For  the  WSF  model  Pc  is  estimated  using  the  following  equation  for  a 
line  scanning  or  push-broom  sensor. 


(km2\  3600 sec  ,  .  \ 

area  covered  [ACRavg  (  sec  J  *  /ir  *  Refresh  (hrs)  * 

global  area  510,000,000(/cm2) 


[10] 


KAsiniSW)) 

ACRavg  =  — - j - -  *  (1  -  Oavg )  *  DC 

where  ACRavg  is  the  average  area  coverage  rate,  Trefresh  is  the  dwell  time  for  the 
instrument,  x;  is  the  number  of  systems  of  type  i  with  a  particular  instrument,  Ka  is  a 


[11] 
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constant  equal  to  2.556  x  10  for  area  in  km",  SW  is  the  swath  width  for  the  instrument,  P 
is  the  orbital  period,  Oavg  is  the  average  swath  overlap,  and  DC  is  the  duty  cycle  of  the 
instrument  [1],  A  typical  average  swath  overlap  of  .2  was  assumed  and  a  duty  cycle  (DC) 
of  1  was  assumed. 

Payload  Performance  Assessment  Models 

The  performance  models  for  WSF  are  primarily  physics  and  geometry  based 
models.  The  performance  assessment  models  are  specific  to  the  function  and  technology 
types.  Sensor  perfonnance  is  estimated  by  calculating  the  estimated  SNR  or  NEDT. 

SNR  is  calculated  using  methods  outlined  in  [1]  using  the  following  equation: 

Ne 

SNR~Yt  I12! 

where  Ne  is  the  estimated  number  of  signal  electrons  and  Nt  is  the  total  estimated  number 
of  noise  electrons.  NEDT  is  also  estimated  using  methods  outline  in  [1]  and  estimated  to 
the  first  order  using  the  equation: 

Nt 

NEDT~-j-  [13] 

AN 

where  Nt  is  the  total  number  of  noise  electrons  and  AN  is  the  increase  in  number  of 
estimated  signal  electrons  associated  with  an  increase  in  signal  temperature  of  1  degree 
Kelvin.  Performance  assessment  models  are  further  detailed  in  appendix  B  of  this  article. 

Analyzing  the  WSF  Optimization  Results  and  Updating  the  WSF  Reference 

Architecture 

The  WSF  optimization  was  implemented  using  the  MATLAB™  (industry 
standard)  genetic  algorithm.  An  initial  population  of  100  randomly  generated  solutions 
was  created.  The  mutation  rate  was  set  to  0.2  and  the  convergence  criteria  was  set  to  a 
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maximum  of  100  generations  or  20  generations  with  less  than  $1K  estimated  life  cycle 
cost  difference  between  generations.  The  optimization  was  executed  for  10  trials  with  a 
relative  minimal  variation  in  the  objective  function.  Each  final  solution  was  assessed  for 
model  accuracy  and  constraints.  The  best  of  the  10  solutions  was  chosen  as  the 
converged  solution.  This  converged  solution  is  summarized  and  assessed  in  the 
subsequent  results  section  of  this  paper. 

The  DISCO  methodology  enables  a  system  architect  to  perform  requirements 
trades.  The  impact  on  Life  Cycle  Cost  (LCC)  can  be  estimated  by  varying  refresh, 
resolution,  coverage,  or  performance  requirements,  as  well  as  executing  the  optimization 
routine  multiple  times.  To  demonstrate  this  method  the  critical  performance  requirement 
Ocean  Surface  Wind  Vector  (OSWV)  revisit  was  traded.  A  trade  was  conducted  between 
estimated  LCC  and  estimated  OSWV  revisit.  Estimated  refresh  time  (Trefresh)  closely 
approximates  the  average  revisit  time  for  an  optimized  Walker  constellation.  The 
results  of  this  trade  are  summarized  in  Eigure  16.  The  estimated  refresh  time  was 
adjusted  in  one  hour  increments  from  the  threshold  requirement  of  6  hours  to  the 
objective  requirement  of  1  hour.  Five  trials  were  executed  for  each  increment.  The  result 
was  a  near  exponential  increase  in  estimated  LCC.  The  results  show  that  the  number  of 
satellites  and  estimated  LCC  increases  dramatically  above  a  refresh  of  4  hours.  An 
architect  could  use  such  trade  study  results  to  negotiate  mission  requirements  with 
stakeholders  to  detennine  whether  the  increase  in  performance  justifies  the  estimated 
increase  in  LCC.  This  analysis  assumes  that  all  other  constraints  and  parameters  are  held 
constant.  Due  to  the  complex  design  space,  it  is  necessary  to  vary  one  constraint 
requirement  at  a  time  in  conducting  these  types  of  trades  using  the  DISCO  methodology. 


81 


Figure  16.  Example  sea  surface  wind  vector  refresh  trade  study  analysis  using  the  DISCO  methodology. 

Results 

Initial  Solution 

The  identified  minimum  estimated  life-cycle  cost  WSF  conceptual  solutions 
consists  of  a  total  of  8  small  satellites  in  a  family  of  systems  with  the  NOAA/NASA  JPSS 
spacecraft.  This  8  satellite  constellation  solution  consists  of  2  small  imaging  satellites,  4 
small  microwave  satellites,  and  2  space  weather  satellites.  Six  Minotaur  Launch  vehicles 
were  identified  as  part  of  this  solution  (one  Minotaur  4  launch  vehicle  was  identified  to 
deploy  each  set  of  small  imaging  satellites  and  a  space  weather  satellite,  and  one 
Minotaur  4  for  each  small  microwave  satellite.  A  graphical  depiction  of  the  initial 
satellite  constellation  is  displayed  in  Figure  17. 
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Figure  17.  Optimized  WSF  constellation. 


Analysis  of  the  solutions  was  performed  by  modeling  the  candidate  architectures  in  a 
dynamics  simulator  as  walker-delta  constellations  in  order  to  assess  average  and 
maximum  revisit  times.  The  requirement  for  refresh  represents  the  maximum  value  of 
the  local  average  over  the  set  of  all  locations  in  the  area  of  interest  (i.e  global  area)  [45]. 
The  visible  imager  constellation  consisting  of  one  JPSS  spacecraft  and  two  small  imagers 
had  an  average  revisit  across  1 148  data  points  at  6  degree  intervals  of  2.33  hours  which  is 
better  than  the  required  4  hour  revisit  time  for  imagery.  Additionally,  98.7%  of  the  grid 
points  have  a  revisit  time  of  less  than  4  hours  which  is  better  than  the  required  75%  that 
should  have  a  revisit  time  of  four  hours  or  less.  The  average  maximum  revisit  time  is 
3.93  hours  which  is  less  than  the  required  maximum  revisit  time  of  6  hours.  The  average 
revisit  time  for  the  microwave  sensor  is  6.25  hours  for  1 148  equally  spaced  points  on  the 
earth  separated  by  6  degrees.  This  is  less  than  the  required  refresh  for  soil  moisture  of  8 
hours  and  just  slightly  above  the  required  sea  wind  vector  refresh  rate  of  6  hours. 
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Additional  analysis  is  planned  to  use  numerical  simulation  directly  for  the  dynamics 
model  rather  than  the  approximate  analytical  techniques  used  for  this  case  and  this 
method  should  provide  further  refined  optimization  solutions. 

The  updated  reference  architecture  block  definition  diagram  associated  with  the 
solution  is  displayed  in  Figure  18.  This  updated  block  definition  diagram  displays  the 
estimated  parameters  associated  with  the  optimized  satellite  and  instrument  types 
necessary  to  meet  the  identified  requirement  in  the  most  cost  effective  manner.  The 
update  of  this  block  defintion  diagram  is  currently  a  manual  process  but  an  on-going 
effort  is  underway  to  develop  techniques  to  automatically  update  these  values  via 
executable  parametric  diagrams.  The  overall  calculated  satellite  cost  estimates  appear 
reasonable  when  compared  to  analogous  systems.  For  example  the  estimated 
development  cost  of  the  small  microwave  satellite  with  a  .8  meter  antenna  is  $1 19 
Million.  The  Quickscat  wind  vector  microwave  scatterometer  with  a  1  meter  dish  cost 
approximately  $98M  in  2002  which  is  inflation  adjusted  to  $131.1  Million  2010  dollars 
[47].  The  development  cost  of  the  small  imaging  sensor  with  a  .014  m  visible  sensor  and 
a  .032  m  infrared  sensor  is  calculated  at  $18.4  Million.  The  cost  to  develop  the  Bi- 
spectral  Infrared  Detector  with  similar  specifications  and  an  additional  long  wave 
infrared  sensor  was  developed  for  $  1 5  Million  Euro  in  2003  which  is  approximately 
$25.2  Million  dollars  after  currency  conversion  and  adjustment  for  inflation  to  2010 
dollars.  [48]  Cost  data  for  the  SENSE  cubesats  was  not  publically  availible,  however  the 
approximated  development  cost  of  $4.97  million  is  a  conservative  cost  estimate  for 
historical  3U  cubesats.  The  space  weather  satellites  have  masses  at  the  lower  limit  of  the 
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SSCM  and  it  has  been  proposed  that  cubesat  specific  cost  models  should  be  developed  to 
more  accurately  estimate  cubesat  development  and  production  costs. 

Once  the  WSF  optimized  conceptual  architecture  solution  was  identified  using  the 
DISCO  methodology  a  comparative  analysis  was  performed  to  detennine  the  potential 
benefits  obtained  via  a  DISCO  optimized  Disaggregated  Weather  Satellite  Follow-on 
(DWSF)  architecture.  The  results  of  this  comparative  analysis  are  summarized  in 
subsequent  section. 

Comparison  of  Optimized  Solution  with  Previously  Identified  WSF  Concepts 

In  2010  the  U.S.  Congressional  Budget  Office  identified  potential  options  for 
modernizing  military  weather  satellites.  This  report  assessed  the  estimated  cost  for 
space-based  weather  systems  based  upon  the  inclusion  of  existing  sensors  on  large  multi¬ 
function  satellites.  The  report  assessed  three  conceptual  spacecraft  options.  The  first 
option  consisted  of  a  satellite  with  the  Visible  Infrared  Imaging  Radiometer  Suite 
(VIIRS)  payload  that  is  currently  on-orbit  aboard  the  SUOMI  NPOESS  Preparatory 
Program  (NPP)  satellite,  the  MIS  sensor  based  upon  a  sensor  design  developed  by  the 
Naval  Research  Lab  for  the  NPOESS  spacecraft,  and  the  Space  Environment  Monitor- 
NPOESS  (SEM-N)  payload.  The  second  option  consisted  of  spacecraft  with  Advanced 
Very  High  Resolution  Radiometer  (AVHRR),  MIS,  and  SEM-N  payloads.  The  third 
option  consisted  of  AVHRR,  Microwave  Imager/Sounder  and  AMSU-A  [33].  All  three 
options  presented  in  this  CBO  report  assumed  that  the  military  would  transition  from  two 
satellites  (one  in  an  AM  and  another  in  a  Mid-AM  orbit)  to  a  single  AM  orbit.  This 
transition  would  not  meet  the  needed  data  refresh  rates  identified  by  the  weather 
stakeholders.  Additionally,  the  AVHRR  instrument  included  in  option  2  and  option  3 
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would  not  provide  the  needed  imagery  horizontal  cell  size  identified  by  the  stakeholders. 
Option  3  also  does  not  provide  ocean  surface  wind  speed,  wind  direction,  or  temperature 
provided  by  the  DMSP  satellite  and  identified  as  a  DoD  Key  Performance  Parameter 
(KPP)  by  the  military  weather  stakeholder  community.  A  significant  effort  was  made  to 
compare  WSF  options  that  meet  critical  military  weather  needs  while  providing  a  fair 
comparison  between  the  DISCO  optimized  conceptual  architecture  and  the  previously 
assessed  WSF  options.  Accordingly  the  CBO  option  one  was  extrapolated  to  include  2 
satellites  (AM  and  mid-AM)  to  meet  military  revisit  threshold  requirements.  The 
estimated  life-cycle  costs  for  this  solution  were  then  estimated  using  the  same  model 
assumptions  as  the  DISCO  optimized  WSF  constellation  using  the  appropriate  USCM 
and  NICM  CERs.  The  CBO  option#  1  derived  option  is  essentially  identical  to  the 
previous  DWSS  program  and  is  hereafter  referenced  as  the  DWSS  option  accordingly. 
The  life  cycle  cost  comparison  between  the  DWSS  architecture  concept  and  the 
Disaggregated  Weather  Satellite  Follow-on  (DWSF)  Concept  is  summarized  in  Table  7. 
This  LCC  comparison  also  includes  conservative  estimates  for  the  number  of  satellites 
required  to  replace  the  small  satellites  versus  the  large  satellites.  A  more  detailed 
breakout  of  the  LCC  components  is  provided  in  appendix  B  of  this  article.  The  CBO 
LCC  estimates  were  based  upon  cost  information  provided  by  the  NPOESS  program. 
These  CBO  estimates  are  within  the  standard  error  for  the  USCM  estimated  satellite 
development  and  production  costs. 
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Figure  18.  Updated  reference  architecture  block  definition  diagram. 
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Table  7.  Estimated  Life  Cycle  Costs  (LCC)  for  optimized  Disaggregated  Weather  System  Follow-on 
Solution  compared  to  the  Defense  Weather  Satellite  System  (DWSS)  reference. 


DWSS 

DWSF  solution 

USCM  ($M) 

SSCM  ($M) 

Total  Satellite  development  cost 

$ 

1,342 

$ 

148 

Total  Satellite  production  cost 

$ 

829 

$ 

168 

Total  Satellite  replacement  cost 

$ 

1,659 

$ 

468 

Total  Ground  system  integration,  data  processing  sw 

$ 

1,200 

s 

1,200 

Total  Launch  (Deployment)  cost 

$ 

688 

$ 

396 

Total  Storage  cost 

$ 

140 

$ 

400 

Total  Operations  cost 

$ 

900 

$ 

900 

Total  Ground  system  sustainment  /  engineering  support 

$ 

400 

$ 

400 

Total  Retirement  cost 

$ 

30 

$ 

30 

Total  estimated  Life  Cycle  Cost  (ROM) 

$ 

7,188 

$ 

4,110 

Total  estimated  Life  Cycle  Cost  (ROM)  standard  error* 

$ 

1,285 

$ 

_ 75 

*Note:  The  standard  error  was  calculated  only  for  cost  elements  estimated  by  a  cost  model  (spacecraft  development  and  production 
costs).  CBO  option#  1  is  extrapolated  from  the  cost  estimates  provided  in  [33].  For  comparison  purposes,  the  satellite  costs  for  the 
CBO  option  was  estimated  using  the  corresponding  USCM  model  with  results  identified  in  the  second  column  of  estimates.  The  CBO 
solution  was  identified  by  determining  the  number  of  satellites  necessary  to  meet  the  WSF  requirements  identified  previously.  The 
corresponding  life-cycle  costs  are  identified  in  the  third  column  of  estimates.  The  DWSF  solution  also  meets  the  WSF  requirements 
identified  in  the  preceding  section.  All  lifecycle  cost  estimates  are  adjusted  to  2010  year  dollar. 


According  to  this  comparative  analysis  there  is  potentially  significant  ($3  Billion) 
LCC  savings  realized  by  adapting  a  DISCO  optimized  DWSF  conceptual  architecture 
solution.  Additionally,  the  estimated  LCC  for  the  DWSF  solution  ($4.1  Billion)  is  less 
than  lower  cost  CBO  options  2  ($4.9  Billion)  and  options  3  ($4.4  Billion)  that  did  not 
meet  critical  DOD  mission  needs  including  refresh/revisit  rate,  measurement  cell  size, 
and  in  the  case  of  option  3  critical  functionality  (ocean  wind  speed  and  wind  direction). 
The  estimated  life  cycle  cost  savings  are  the  result  of  multiple  efficiencies  gained  through 
the  optimization  and  disaggregation  methods.  The  VIIRS  and  MIS  payloads  identified 
for  the  DWSS  satellite  were  designed  for  a  larger  set  of  joint  civil  and  military 
(NPOESS)  requirements  than  those  required  for  the  military  WSF  mission.  The 
expanded  set  of  requirements  led  to  larger,  more  complicated,  and  thus  costlier  payload 
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conceptual  designs.  For  example  one  of  the  driving  requirements  for  the  VIIRS  payload 
was  the  need  to  accurately  detect  ocean  color.  The  ocean  color  requirement  (which  is  not 
a  defense  related  requirement)  led  to  a  larger,  higher  power,  higher  data  rate  VIIRS 
imagery  payload.  This  complex  imagery  payload  design  was  carried  over  to  the  DWSS 
concept.  By  optimizing  the  payload  conceptual  design  criteria  to  the  subset  of 
requirements  needed  for  the  WSF  mission  the  imagery  and  microwave  payload  mass, 
volume,  power,  data  rate  and  consequently  estimated  cost  is  reduced  significantly. 
Additionally,  the  multitude  of  required  environmental  data  types  also  led  to  a  single 
aperture  multi-spectral  (VIIRS)  imagery  payload  design.  The  beam-splitters,  multi- 
spectral  filters,  and  multiple  reflective  surfaces  required  to  implement  an  aggregated 
multi-spectral  payload  led  to  significant  signal  losses.  A  larger  aperture  with 
correspondingly  larger  mass,  power,  and  data  rate  was  thus  required  for  DWSS  to  meet 
the  SNR  and  NEDT  constraints.  The  reduction  of  losses  garnered  by  disaggregating  the 
visible  and  infrared  sensors  (without  beam  splitters,  multi-spectral  filters,  and  reflective 
surfaces)  enables  a  significantly  smaller  aperture  and  consequently  more  economical 
imagery  payloads  for  the  DWSF  small  satellites.  Smaller  payloads  also  enable  smaller 
satellites  and  consequently  more  cost  effective  launch  vehicles.  Additional  cost 
efficiencies  are  gained  by  fine  tuning  the  constellation  design  to  the  requirements.  Two 
large  multi-function  satellites  are  required  to  meet  the  revisit  requirements  given  the 
assumed  DWSS  orbital  altitude  of  840  km  with  the  existing  payload  specifications.  An 
architecture  based  upon  small  spacecraft  allows  a  better  fine  tuning  of  revisit  timelines 
and  thus  enhanced  economic  efficiencies. 
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Conclusion 


An  adaptation  of  the  Disaggregated  Integral  System  Concept  Optimization 
(DISCO)  methodology  was  made  to  handle  multi-function/multi-orbit  problems,  as 
exemplified  by  the  Weather  System  Follow-on  (WSF)  concept.  The  application  of 
DISCO  indicates  that  the  methodology  is  able  to  address  real-world  disaggregation 
problems  with  efficiencies  in  personnel  and  resources,  when  compared  with  traditional 
manually  intensive  engineering  approaches.  These  traditional  approaches  often  only 
examine  a  few  solutions,  typically  evolutionary  from  past  architectures,  without  an 
attempt  for  overall  system  optimality.  Literature  identified  several  space  constellation 
optimization  approaches,  but  these  only  addressed  distributed  multi-orbit  homogeneous 
solutions,  orbit  optimization  for  single  satellites,  or  multi-function  solutions  constrained 
to  existing  sensors.  While  offering  a  strong  foundation,  none  of  these  extant  methods 
have  been  fonnulated  to  handle  the  integrated  sensor/payload  (multi-function)  and  multi¬ 
orbit  problem.  Interestingly,  the  DISCO  methodology  found  a  potential,  cost-effective 
solution  for  the  WSF  program.  This  solution  consisted  of  8  satellites  (2  small  imaging 
satellites,  4  small  microwave  satellites,  and  2  small  space  weather  satellites),  and  6 
Minotaur  launch  vehicles.  This  solution  has  an  estimated  $3Billion  lifecycle  cost  savings 
over  a  large  multi-function  DWSS  approach,  which  should  be  further  assessed. 


90 


Chapter  III  Appendix  A  -  Optimization  formulation3 
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Pd  >  -99 


s.t.  G 2(x1A5,y1JAji5j)  >  .99  ->  ( Pd )  Pd  =  Ps  *  Pc 


0  <  Xl  l  <  10  (#  satellite  planes) 

0  <  x12  <  10  (#  satellites  per  plane ) 

200  <  y1±  <  35178  ( orbital  height  [km]) 

■  04  <  y12  <  1  ( aperture  diameter  —  imager  [m]) 

0  <  y13  <  65.66  (max  nadir  angle  [degs]) 

■  36  <  y14  <  2  ( aperture  diameter  —  microwave  [m]) 

0  <  y15  <  65.66  (max nadir  angle  [degs]) 

400  <  Msc  <  5127  (JJSCM  mass  model  limits  [kg]) 

A  <  ECAlimb  (earth  central  angle  limit  -  imager,  microwave  [degs]) 
e  <  20  ( minimum  elevation  angle  —  imager, microwave  [degs]) 

CSnadir  —  400  ( reqd  nadir  cell  size[m]  —  imager) 

CSeos  <  800  ( reqd  edge  cell  size[m]  —  imager) 

SI  >  GSDdiff  ( sample  interval  diffraction  limit  —  imager) 

SNR  >119  ( required  imagery  sensor  performance  —  visible) 

NEDT  <  .396  (required  sea  surface  temp  sensor  performance  —  infrared) 
CSeos  <  20,000  ( reqd  edge  cell  size[m]  —  microwave) 

SI  >  GSDdiff  ( sample  interval  diffraction  limit  —  microwave) 

NEDT  >  .7  (required  sea  surface  wind  sensor  performance  —  microwave) 

0  <  x21  <20  (#  satellite  planes) 

0  <  x22  <  20  (#  satellites  per  plane) 

200  <  y21  <  35178  (orbital  height  [km]) 

.  00154  <  y2  2  <  .0385  (aperture  diameter  —  visible  imager  [m]) 

0  <  y2,3  <  65.66  (max  nadir  angle  [degs]) 

.  0046  <  y24  <  .115  (aperture  diameter  —  infrared  imager  [m]) 

0  <  y2  5  <  65.66  (max  nadir  angle  [degs]) 

20  <  Msc  <  400  (SSCM  mass  model  limits  [kg]) 

A  <  ECAlijnb  (earth  central  angle  limit  [degs] -visible,  infrared  imager  [degs]) 


3  Note  that  the  optimization  objective  function  is  a  non-linear  and  discrete  function  despite  initial 
appearances.  The  estimated  system  cost  terms  ( cfev ,  cf1  od,  c°ps ,  c'-upt ,  c[et)  are  functions  of  the  problem 
design  variable  vector  (x)  for  satellite  system  types.  Additionally,  the  system  number  terms 
(xfev ,xprod ,x°ps ,x*upt ,x[et)  are  also  functions  of  the  problem  design  variable  vector  (x)  and  can  only 
have  integer  values.  The  xis  terms  identified  in  the  optimization  formulation  are  system  specific  design 
variables  included  in  the  design  variable  vector  (x).  The  yis  terms  identified  in  the  optimization 
formulation  are  continuous  system  specific  design  variables  included  in  the  design  variable  vector  (x). 
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£  <  20  ( minimum  elevation  angle  —  visible,  infrared  imager  [degs]) 
CSnadir  ^  400  (reqd  nadir  cell  size[m ]  —  imager ) 

CSeos  <  800  ( reqd  edge  cell  size[m ]  —  imager ) 

SI  >  GSDdiff  ( sample  interval  diffraction  limit  —  imager ) 

SNR  >  119  ( required  imagery  performance  —  visible  sensor ) 

NEDT  <  .396  ( required  sea  surface  temp  performance  —  infrared  sensor ) 
CSeos  <  20,000  (reqd  edge  cell  size[m]  —  microwave ) 

SI  >  GSDdiff  (sample  interval  dif fraction  limit  —  microwave ) 

NEDT  >  .7  (required  sea  surface  wind  performance  —  microwave  sensor ) 
0  <  x31  <20  (#  satellite  planes) 

0  <  x3  2  <  20  (#  satellites  per  plane ) 

200  <  y31  <  35178  (orbital  height  [km]) 

■  2  <  y3  2  <  1  (aperture  diameter  —  microwave  [m]) 

0  <  y3  3  <  65.66  (max  nadir  angle  [degs]) 

20  <  Msc  <  400  (SSCM  mass  model  limits  [kg]) 

X  <  ECAlimb  (earth  central  angle  limit  [degs]-microwave  [degs]) 
e  <  20  (minimum  elevation  angle  —  microwave  [degs]) 

CSeos  <  20,000  (reqd  edge  cell  size[m]  —  microwave) 

SI  >  GSDdiff  (sample  interval  diffraction  limit  —  microwave) 

NEDT  >  .7  (required  sea  surface  wind  performance  —  microwave  sensor) 
x4  —  2  (assumed  2  space  weather  satellites  in  constellation) 


0  <  Xr}  <  40  (bounds  on  ttPegasus  launch  vehicles) 

0  <  x6  <  40  (bounds  on  #Pegasus  launch  vehicles) 

0  <  x7  <  40  (bounds  on  #Pegasus  launch  vehicles) 

0  <  x8  <  40  (bounds  on  #Pegasus  launch  vehicles) 

0  <  x9  <  40 (bounds  on  # Pegasus  launch  vehicles) 

Msats  ^  LCLVs(Total  mass  of  satellites  less  than  total  lift  capacity) 
Npianes  ^  NLVs(Total  #  of  satellite  planes  less  then  #  of  launch  vehicles) 

wh  xio  =  {0,1}  for  all  i 

ere 


x  =  [xx,  x2, ... ,  xn±]  x  is  an  integer 


y  =  [yi-y2.  -yn2]  y  is  continuous 


cio  and  Cj  are  functions  of  x  and  y 


92 


Chapter  III  Appendix  B  -  Example  sensor  performance  calculations 


Sea  Surface  temperature 

The  table  below  provides  an  example  of  the  sensor  performance  calculation  method  for 
SST  NEDT  calculation.  Similar  calculations  were  completed  for  each  sensor 
performance  requirement. 


Reference  Large  satellite  clear  weather  Sea  Surface  Temperature  (SST)  Mid-wave  Infrared  (MWIR)  NEDT 
calculation  as  derived  from  Table  17-9  of  [1] 


Parameter 

1  Large 

MF 

units 

equation 

Orbital  Altitude  [hi 

779967.01 

m 

Orbit  Period  [PI 

100.45 

min 

P=1.658669E-4*(Re+h)A(3/2) 

Ground  Track  Velocity  [Vgl 

6.65 

km/s 

Vg=  2*Pi*Re/P 

Node  shift  [AL1 

25.18 

deg 

deltaL=P/1436min*360deg 

Angular  radius  of  the  earth  [p] 

63.00 

deg 

arcsin(Re/(Re+h)) 

max  earth  Central  Angle  [Aol 

27.00 

IR  imager  (VIIRS)  -  M12  Sea  Surface 

Temp 

Range  to  the  horizon  [Dmaxl 

m 

Minimum  Elevation  Angle 

20.00 

deg 

Sensor  look  angle  (nadir  angle)  [r|] 

51.83 

deg 

elevation  angle  [61 

28.08 

deg 

ACOS(SIN(ti)/SIN(Ao)) 

incidence  angle  [IA1 

61.92 

Earth  Central  Angle  [A] 

10.09 

deg 

Slant  Range  [Rsl 

1421713.0 

0 

m 

Swath  Width  [2*A1 

20.18 

deg 

2*A 

Max  vertical  cell  size  at  edge 

1300.00 

m 

Max  horizontal  cell  size  at  edge 

1300.00 

m 

Max  vertical  cell  size  at  nadir 

1000.00 

m 

Max  horizontal  cell  size  at  nadir 

1000.00 

m 

Diffraction  limited  GSD  at  Nadir 

18.9030 

m 

GSD diff nadir=h*A/D 

Diffraction  limited  GSD  at  Edge 

34.4561 

m 

GSD diff nadir=R s*A/D 

Specified  Max  along  track  GSD,  [Yeos] 

1195.45 

m 

Along  track  Instantaneous  Field  of  View 
[IFOVyI 

0.0482 

deg 

IFOV Y=(Y eos/R s)*(180/pi) 

Native  eos  cross  track  pixel  resolution 
[Xlimitl 

2539.66 

m 

Number  of  cross  track  detector  samples  at 
nadir  [X#| 

2.00 

X#=Xlimit/HCSeos 

Effective  eos  cross  track  pixel  resolution 
[Xeosl 

1269.83 

Xeos=Xlimit/X# 

Cross  Track  Instantaneous  Field  of  View 
fIFOVxl 

0.0482 

cross  track  ground  pixel  resolution 
[Xnadirl 

655.84 

m 

Xnadir=IFOVx*h*(pi/180) 

along  track  ground  pixel  resolution 
[Ynadirl 

655.84 

m 

Ynadir=IFOVy*h*(pi/180) 

#  of  cross  track  pixels  [Zcl 

2151.52 

pixels 

Zc=2*n/IFOVx 

#  of  swaths  recorded  along  track  in  1  sec 
[Zal 

10.14 

swaths 

Za=Vg*l/Y 
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#  of  pixels  recorded  in  1  sec  [Z] 

2.18E+04 

pixels 

Z=Zc*Za 

#  of  bits  used  to  encode  each  pixel  [B] 

8.00 

bits 

parameter 

Data  Rate  [DR] 

0.17 

Mbps 

DR=Z*B*Nbands 

#  of  pixels  for  whiskbroom  [Nm] 

32.00 

pixels 

parameter 

Swath  overlap 

1.13 

parameter 

pixel  integration  period  [Til 

3.75E-04 

seconds 

(Y/Vg)*(Nm/0)*(#X/(2*Pi*h) 

pixel  read  out  frequencty  [Fpl 

2663.38 

Hz 

Fp=l/Ti 

detector  time  [Tdet| 

seconds 

detector  pixel  width  [d] 

1.00E-05 

meters 

parameter 

quality  factor  for  imaging  [Q1 

1.10 

parameter 

operating  wavelength  [A1 

3.70E-06 

meter 

focal  length  [FI 

1.14 

m 

aperature  diameter  [Dal 

0.153 

m 

design  variable 

Edge  of  Service  SNR  Calculation 

Blackbody  temp  [T] 

270.00 

K 

parameter 

Operating  Bandwidth  [AA1 

1.80E-07 

m 

parameter 

Emissivity 

1 

Emitted  power  density  [EA1 

300138.44 

54 

W/mA2- 

m-sr 

/2  *pi*h*c2*e\  f  1  \ 

Blackbody  spectral  radiance  [LAI 

2.39E+04 

L(A)=E(A)/(4*pi) 

transmissivity  of  the  atmosphere  [x| 

0.90 

Modtran  estimated 

Upwelling  radiance  [Lupil 

2.15E+04 

Lupi(A)=L A*x  (A) 

Integrated  upwelling  radiance  [Lintl 

3.87E-03 

W/mA2/ 

sr 

Lint=y,Lupi('Ai-Ai+l) 

radiated  power  /pixel  [LI 

5873.59 

W/sr 

L=Lint*X*(Y/X#) 

input  power  [PI 

5.32E-11 

W 

Pin=(L/hA2)*(D/2)A2*pi 

Number  of  reflective  surfaces 

10 

Number  of  beamsplitters 

1 

Number  of  optical  filter  interfaces 

16 

Incidence  angle  [0 inc| 

1 

index  of  refraction  [nl 

1.35 

m 

1 

spectral  filter  thickness  [dl 

1.37E-06 

d=(m*A)/(2*n) 

Beta  angle  [(?] 

0.62 

P=asin(sin(0 inc)/n) 

Varphi  [<p] 

5.108 

<p=(4*pi*n*d)/(m*A) 

Etrans 

0.970 

Filter  reflectivity 

0.500 

Eo 

3.459 

Eo=(l+(4*  p)/(l-p)A2*sin(<p/2)A2 

filter  optical  transmittance  [x filter] 

0.280 

x filter=E trans/E o 

optical  transmission  factor  [to] 

0.04 

input  power  at  detector  pixel  [Pd] 

2.19E-12 

Pd=Pin*xo 

energy  after  integration  [E] 

8.24E-16 

E=Pd*Ti/X# 

#  of  available  photons  [Np] 

1.53E+04 

Np=E*A/h*c 

Quantum  Efficiency  [QE1 

0.50 

#  of  electrons  available  [Ne] 

7673.90 

Ne=Np*QE 

#  of  noise  electrons  [Nil] 

87.60 

Nn=NeA.5 

#  of  read  out  noise  electrons  [Nr] 

25.00 

total  #  of  noise  electrons  [Nt] 

91.10 

Nt=(NnA2+NrA2)A.5 

Signal  to  Noise  Ratio  [SNR] 

84.24 

SNR=Ne/Nt 

Dynamic  Range  [cold  space)  [DR] 

306.96 

DR=Ne/Nr 

Required  SNR 

10.00 

ratio 

Edge  of  Service  NEDT  Calculation  (+1 
deg  K) 

AN 

418.85 

# 

AN=Ne new-Ne 

NEDT 

0.2229146 

52 

ratio 

NEDT=Nt/AN 

Required  NEDT 

0.396 
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An  optical  system  which  collects  mission  data  in  multiple  bands  (such  as  the  VIIRS 
payload)  requires  a  relatively  large  aperture  due  to  signal  loss  associated  with  adaptive 
optics,  beamsplitters,  and  optical  filters.  Approximately  3%  of  an  optical  signal  is  lost 
per  clear  optics  interface.  Approximately  5%  of  an  optical  signal  is  lost  per  reflective 
optical  interface.  An  optical  signal  is  reduced  by  approximately  58%  through  a  beam 
splitter.  Additionally,  measurement  bands  are  typically  produced  via  optical  filters.  The 
relative  signal  loss  of  an  optical  filter  is  dependent  upon  sensor  view  angle  according  to 
the  following  equations: 


^ filter 


Etrans 


E0(9 )  =  (1  + 


4  *  p 


-)  *  sin 


[14] 

[15] 


where  Eo  is  the  emissivity  of  the  optical  filter,  p  is  the  filter  surface  reflectance,  (p  is  an 
angular  function.  Consequently  these  losses  account  partially  for  the  larger  aperture 
diameter  required  for  a  multi-band  multi-function  optical  sensor  (such  as  VIIRS)  versus 
the  single  band  HSRS  imaging  sensor  on  the  Bi-spectral  Infrared  Detector.  These  optical 
loss  estimates  are  derived  from  the  AFIT  multi/hyper  spectral  fundamentals  course  notes. 


Sea  surface  wind  performance  model 

Space  based  microwave  radiometry  sensors  have  been  used  extensively  to 
detennine  sea  surface  wind  speed  and  vectors.  The  empirically  derived  algorithm  to 
estimate  sea  surface  wind  speed  from  microwave  brightness  readings  is: 


95 


rm\ 

estimated  wind  speed  ( — J  —  147.9  +  1.0969  *  B19  V  —  .4555  *  B2 2y  ~  1-760  *  B37V  +  .7860  *  B37H 
The  algorithm  has  an  accuracy  <2  m/s  if  rain  is  not  present  and  the  required  cell  size  and 

NEDT  meet  the  stated  requirements.  There  is  a  correction  for  water  vapor  contamination 
or  high  wind  speeds  [44] .  Microwave  transmittance  over  the  ocean  is  dependent  upon 


sensor  angle  based  upon  angle  of  incidence  according  to  the  following  equations: 


f(0,v)  = 


s2cosd1  —  V/U2£2  —  sin2 


e2cosd1  +  V/t2£ 2  —  sin2  &i 


[16] 


Where  T(9,  v)  is  the  vertically  polarized  microwave  transmittance  of  a  dielectric  surface, 
s  is  the  relative  complex  dielectric  constant,  p  is  the  relative  magnetic  permeability  of 
medium  2  (ocean  salt  water)  [49].  This  relationship  was  coded  into  the  microwave  SNR 
and  NEDT  calculation  functions. 


Soil  Moisture 

Soil  moisture  from  the  surface  layer  to  a  few  millimeters  can  be  assessed  under  sparse  or 
incomplete  vegetation  cover.  For  low  density  vegetation  the  equation  for  estimating  soil 
moisture  is: 


Soil  moisture  —  .5  *  API 


[17] 


where: 


AP how  =  659.35  -  675.22  *  TB(19fl) 


[18] 


D  _  FB(l9y)  +  TB(37y)  7b(19H)  +  37H) 

B  - - 2 - + - 2 - 

This  estimating  equation  is  accurate  within  ±10%  volumetric  soil  moisture  content 
accuracy  for  the  previously  stated  required  cell  size  and  NEDT  [44], 
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Cost  model  and  cost  comparison  details 

Large  Multi-Function  (LMF)  satellite  development  costs  are  estimated  using  a  combination  of  the 
USCM  for  satellite  related  cost  estimates  and  the  NICM  for  payload  related  cost  estimates  as  discussed  in 
chapter  11  of  Space  Mission  Engineering:  The  New  SMAD  I'll.  The  USCM  estimation  is  a  summation  of 
component  costs  according  to  the  following  equation: 

The  estimated  development  cost  for  a  spacecraft  bus  is  denoted  as  Cp  ™  for  a  payload  is  denoted  as 
Cpfv .  After  inclusion  of  USCM  Cost  Estimating  Relationship  (CER)  values  the  estimated  equation  to 
determine  estimated  large  space  vehicle  development  costs  is: 

^sv,  large  =  (H0.2 Msc)  +  (Cpi)  +  (.  195 (Csv  +  Cp{))  +  A14(CSV  +  Cpl )  +  (.944  *  Csc) 


The  USCM  only  includes  CER  equations  for  communication  satellites.  Consequently  the  NICM  was 
used  to  estimate  the  WSF  payload  costs.  The  NICM  CER  for  an  earth  observation  optical  payload  such  as 
the  WSF  large  satellite  imager  is:  Cpl  —  (l,163Mpi28  *  Ppl57  *  DRp?2)  where  Cpi  is  the  estimated 
development  cost  of  the  optical  payload  in  thousands  of  dollars  ($K),  Mpi  is  the  estimated  mass  of  the 
optical  payload  in  kg,  and  DRpl  is  the  estimated  data  rate  of  the  payload  in  kbps.  The  mass  and  power  of 
the  payload  is  estimated  using  sizing  relationships  based  upon  sensor  aperture  ratio  discussed  in  section 
17.2.6  of  [1].  The  data  rate  is  calculated  for  each  payload  based  upon  the  equation  DR  —  Z  *  B  *  Nbands 
where  Z  is  the  number  of  pixels  recorded  in  one  second  for  a  given  sensor,  B  is  the  number  of  bits  used  to 
encode  each  pixel,  and  Nbands  is  the  number  of  spectral  bands  recorded  as  described  in  table  17-9  of  [1]. 
Likewise,  the  NICM  estimated  development  cost  for  an  active  or  passive  microwave  instrument  is  : 

Cpi  =  23,620  *  Mpl84  *  Pp325  *  DR  ™  *  TRL~j-296 


[21] 


where  Mpl  is  the  mass  of  the  microwave  payload,  Ppl  is  the  power  of  the  microwave  payload,  DRpl  is 
the  data  rate  of  the  payload,  and  TRLpl  is  the  Technology  Readiness  Level  of  the  payload  based  upon  the 
NASA  TRL  scale. 

For  a  large  spacecraft  the  production  cost  is  also  estimated  using  USCM  as  documented  in  [1] 
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prod  _  p prod  .  ^ prod  .  ^ prod  .  prod  .  ^ prod 

^"sv, large  ~  ^ bus  '  ^ pi  '  '-ia&.t  '  '-‘program  '  '-‘loos 


[22] 


The  estimated  space  system  cost  for  a  small  space  system  is  calculated  using  the  Small  Spacecraft  Cost 
Model  (SSCM)  discussed  in  chapter  11  of  [1]. 

The  estimated  development  cost  for  a  small  space  system  is  calculated  as: 

fdev  _  f dev  t  r>dev  t  ndev  i  ndev  i  rdev  i  rdev 

'-ss, small  u bus  '  '-pi  '  '-ia&.t  '  u program  '  '-age  '  usw 

[23] 

Once  the  CER  values  are  populated  the  corresponding  equation  is: 

e-mail  =  (1,064  +  35.5MsC261)  +  (.  4Csc)  +  (.  139Csc)  +  (.  229Cbus)  +  (.  061Cbus)  +  Csw 

[24] 
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IV.  Stochastic  Analysis  Methods 


Introduction 

Today’s  space  systems  have  far  reaching  impacts  to  U.S.  Department  of  Defense 
(DoD)  users  globally.  They  provide  a  multitude  of  mission  applications  such  as 
communications;  global  navigation  and  timing;  precise  weather  and  climate  inputs;  and 
global  intelligence,  surveillance,  and  reconnaissance.  However,  the  systems  that  provide 
these  capabilities  can  be  complex,  costly,  and  highly  susceptible  to  technical  risks  [4].  It 
has  been  hypothesized  that  the  “vicious  circle  of  space  acquisition”  leads  to  space  system 
architectures  consisting  of  a  relatively  small  number  of  large,  complex,  and  expensive 
satellites  that  lack  system-wide  resiliency  [3].  It  has  been  proposed  that  this  is  driven  in 
part  by  a  low  risk  tolerance. 

Disaggregating  space  system  architectures  has  been  identified  as  a  strategy  that 
has  the  potential  to  improve  cost  effectiveness  and  resiliency  of  future  space  system 
architectures.  According  to  a  recent  Air  Force  Space  Command  report  on  disaggregation 
of  space  systems  “disaggregating  space  architectures  is  one  strategy  to  improve 
resiliency,  offering  a  means  to  trade  cost,  schedule,  perfonnance,  and  risk  to  increase 
flexibility  and  capability  survivability”  [50].  However,  the  associated  trade  space  is 
complex  and  highly  mission  specific.  Methods  for  conducting  such  architectural  trades 
represent  a  powerful  and  necessary  capability  for  space  system  architects  aiming  to 
design  cost  effective  and  resilient  space  system  architectures. 
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The  aim  of  this  paper  is  to  document  and  demonstrate  a  potential  methodology  for 
conducting  trades  between  cost-effectiveness,  risk,  and  perfonnance  for  candidate  space 
system  architectures.  A  disaggregated  space  system  optimization  methodology  termed 
Disaggregated  Integral  System  Concept  Optimization  (DISCO)  is  summarized  as  an 
effective  system  architecting  tool.  Catastrophic  space  vehicle  and  launch  vehicle  failures 
are  identified  as  potential  risks  to  space  systems.  The  impact  of  space  vehicle  and  launch 
vehicle  failures  due  to  adverse  conditions  are  modeled  as  cost  risk.  The  corresponding 
space  vehicle  and  launch  vehicle  failure  rates  are  modeled  according  to  empirical  Space 
Vehicle  (SV)  and  launch  vehicle  (LV)  reliability  data.  These  methods  enable  the 
automated  generation,  assessment,  and  cost/risk  optimization  for  a  vast  number  of 
potential  architectural  alternatives.  Explicitly,  this  paper  aims  to  achieve  the  following 
three  objectives. 

1 .  Outline  methods  for  incorporating  probabilistic  satellite  and  launch  vehicle  failure 
rates  associated  with  disaggregated  space  system  optimization  problems 

2.  Demonstrate  how  these  methods  can  be  applied  to  an  applicable  disaggregated 
space  system  optimization  problem  (i.e.  Weather  System  Follow-on  WSF) 

3.  Detennine  how  variations  in  risk  weighting,  failure  rates,  and  performance 
requirements  can  be  assessed  to  perfonn  disaggregated  space  system  trades 
between  cost  and  risk. 

The  results  indicate  that,  for  the  example  application,  the  minimum  cost  disaggregated 
architecture  solution  is  also  the  minimum  risk  solution.  These  architectures  are  also 
shown  to  be  highly  robust  to  large  variations  in  launch  vehicle  and  space  vehicle  failure 
rates. 


100 


Background 

This  article  builds  upon  a  series  of  articles  describing  an  alternative  methodology 
for  modeling,  assessing,  and  optimizing  disaggregated  space  system  conceptual  designs. 
The  methodology  is  tenned  Disaggregated  Integral  System  Concept  Optimization 
(DISCO).  The  general  methodology  was  introduced  and  originally  applied  to  a  basic  fire 
detection  satellite  concept  design  problem  [51]  [52],  Later,  the  DISCO  methodology  was 
tried  on  the  Weather  System  Follow-on  (WSF)  mission  using  multi-function/multi-orbit 
disaggregation  optimization  methods  [53]  [54],  This  paper  documents  an  extension  of 
the  DISCO  methodology  to  assess  the  impacts  of  stochastic  satellite  and  launch  vehicle 
failure  rates  on  the  proposed  Disaggregated  Weather  System  Follow-on  (DWSF) 
architecture.  These  extensions  utilize  extant  probabilistic  satellite  and  launch  vehicle 
failure  models. 

Space  System  Optimization 

Significant  research  has  been  conducted  on  distributed  space  system  optimization 
methods  [16]  [17]  [18]  [19]  [20].  The  DISCO  methodology  represents  an  advancement 
of  these  methods  that  is  capable  of  simultaneously  optimizing  disaggregated  space 
system  architectural  concepts  characterized  by  multiple  heterogeneous  system  types, 
payload  functionalities,  orbital  parameters,  and  satellite  sizing  via  Model  Based 
Conceptual  Design  (MBCD)  methods.  A  relatively  small  amount  of  research  has  been 
conducted  on  introducing  stochastic  parameters  into  distributed  or  disaggregated  space 
system  optimization  methodologies.  Selva  introduced  the  concept  of  modeling  satellite 
development  cost  risk  based  upon  satellite  subsystem  Technology  Readiness  Level  (TRL) 
[20].  This  research  introduced  methods  for  modeling  launch  risk  as  a  function  of  the 
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number  of  instruments  placed  on  orbit  and  the  perceived  preference  to  solutions  that  are 
robust  to  single  launch  failures  [20]. 

Jilla  et  al.  estimated  reliability  of  distributed  satellite  constellations  using  Markov 
Models  [18].  These  authors  also  incorporated  reliability  in  a  launch  vehicle  selection  tool 
as  cost  risk  [55].  The  research  in  this  paper  extends  Jilla's  method  of  modeling  launch 
vehicle  failure  risk  to  the  broader  disaggregated  space  system  optimization  problem. 
These  extensions  account  for  cost  risk  associated  with  the  probability  of  failure  across 
heterogeneous  satellite  constellations  and  heterogeneous  launch  vehicles. 

Space  Vehicle  Reliability 

Traditional  space  system  engineering  methods  often  model  spacecraft  reliability 
according  to  the  cumulative  probability  of  failure  for  “electronic  parts,  connections,  and 
moving  mechanical  assemblies.”  However,  “the  historical  on-orbit  data  do  not  match 
the  reliability  equation  predictions”  for  several  reasons  [1].  First,  these  traditional 
reliability  methods  do  not  account  for  non-component  related  failures  such  as  design 
flaws  and  workmanship  errors.  Second,  assumed  constant  failure  rates  used  by  these 
traditional  methods  do  not  account  for  the  fact  that  “once  functioning,  spacecraft  life 
often  far  exceeds  predictions”  [1].  Consequently,  we  have  chosen  to  model  spacecraft 
failure  rates  based  upon  empirical  on-orbit  data  vice  traditional  reliability  analysis.  A 
relatively  recent  series  of  space  system  reliability  studies  were  published  by  Castet  and 
Saleh.  The  impact  of  design  life  requirements  on  spacecraft  design  was  synopsized  in 
[56].  Weibull  models  were  demonstrated  to  accurately  model  satellite  reliability  versus 
satellite  on-orbit  time  [57].  Furthennore,  satellite  reliability  was  shown  to  vary  according 
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to  satellite  mass  categories  using  Weibull  statistical  models  [58].  The  resulting  satellite 
mass  reliability  models  are  thus  adapted  to  the  DISCO  methodology. 

Launch  Vehicle  Reliability 

Historical  analysis  of  launch  vehicle  failures  has  demonstrated  that  the  overall 
reliability  of  launch  systems  as  a  whole  is  90  to  95%  [59].  This  relatively  low  reliability 
represents  a  significant  risk  for  space  system  conceptual  designs.  Traditionally  launch 
vehicle  reliability  is  estimated  by  decomposing  the  launch  system  into  its  subsystems  and 
statistically  calculating  the  probability  of  each  failure  mode.  Alternatively,  launch  vehicle 
reliability  using  Bayesian  probability  estimation  techniques  are  summarized  in  [60].  The 
Bayesian  reliability  estimation  techniques  have  been  successfully  demonstrated  to 
accurately  capture  launch  vehicle  reliability  and  the  associated  error  distribution  for 
launch  vehicle  families  (i.e.  system  types)  accounting  for  the  relatively  low  success  rate 
for  new  launch  vehicle  types.  The  probabilistic  reliability  calculations  used  in  this  paper 
utilize  the  Bayesian  reliability  estimation  techniques  with  binomial  distributions. 

Monte  Carlo  Analysis 

Monte  Carlo  analysis  is  a  problem  solving  technique  used  to  approximate  the 
probability  of  certain  outcomes  by  running  multiple  trials  while  sampling  stochastic 
parameters.  This  technique  is  often  used  to  assess  the  effect  of  probabilistic  elements  in 
an  operational  systems  model  when  the  decision  environment  is  comprised  of  many 
random  (stochastic)  variables  [61].  In  the  conceptual  design  of  individual  spacecraft, 
Monte  Carlo  methods  have  been  used  to  detennine  sensitivity  of  component  reliability 
[62],  distributed  architecture  trade-space  investigations  [18]  and  assessment  of  satellite 
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swarm  reliability  [63].  In  this  paper,  Monte  Carlo  analysis  will  be  used  to  enable  an 
assessment  of  failure  rate  distribution  impacts  on  the  optimal  conceptual  designs. 

Methods 

Early  in  the  conceptual  design  process  mission  designers  and  system  architects 
must  “make  decisions  on  a  mission  fulfillment  approach  using  small  satellites,  large 
satellites,  or  a  mixture  of  both”  as  described  in  [1].  Traditional  methods  of  conducting 
space  system  conceptual  architecture  trades  are  often  limited  to  the  design,  assessment, 
and  improvement  of  a  few  candidate  architectures.  These  traditional  system  architecting 
methods  are  potentially  inadequate  to  effectively  design,  assess,  and  optimize  the  vast 
conceptual  design  space  associated  with  disaggregated  space  systems.  This  design  space 
is  further  complicated  by  stochastic  parameters  such  as  space  vehicle  and  launch  vehicle 
reliability.  The  DISCO  methodology  is  a  potentially  powerful  tool  enabling  effective 
analysis  of  this  vast  trade  space.  This  methodology  section  consists  of  five  parts.  First, 
an  overview  of  the  DISCO  methodology  is  presented.  Secondly,  extensions  to  the 
DISCO  optimization  formulation  are  proposed  that  account  for  satellite  and  launch 
vehicle  reliability  impacts.  Third,  a  method  for  incorporating  satellite  reliability  based 
upon  Weibull  distribution  models  is  outlined.  Fourth,  a  method  for  incorporating  launch 
vehicle  reliability  based  upon  Bayesian  probability  model  is  introduced.  Finally,  Monte 
Carlo  methods  enabling  the  assessment  of  conceptual  design  impacts  associated  with  the 
distribution  of  stochastic  failure  rates  is  introduced.  These  methods  will  form  the  basis  for 
the  analysis  presented  in  the  application  and  results  sections  of  this  article. 
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DISCO  Methodology  Overview 


The  primary  motivation  for  the  Disaggregated  Integral  System  Concept 
Optimization  (DISCO)  methodology  is  the  enablement  of  improved  system  analysis  and 
optimized  solutions  across  all  disaggregation  types  (i.e.  multi-orbit,  multi-function, 
hosted  payloads,  and  fractionation).  An  overview  of  all  potential  logical  decompositions 
is  presented  in  Figure  19.  Figure  20  shows  a  general  overview  of  the  DISCO  approach. 
The  general  DISCO  problem  solving  approach  consists  of  the  following  components: 
reference  system  architecture,  dynamics  models,  performance  assessment  models,  and 
mixed  variable  optimization  functionality. 

The  architecture  reference  model  fonns  the  basis  of  the  disaggregated  space 
system  optimization  approach.  The  primary  stakeholder  needs,  mission  objectives, 
system  requirements,  and  logical/physical  architecture  artifacts  are  modeled  in  a  MBSE 
architecture  tool.  The  architecture  reference  model  is  kept  in  concordance  with 
perfonnance/quality  assessment  and  dynamics  simulations  via  engineering  analysis.  This 
concordance  may  be  maintained  via  an  automated  electronic  means  or  through  manual 
manipulation  as  currently  implemented.  System  requirements  documented  in  the 
architecture  reference  model  (e.g.  coverage,  resolution,  sensitivity,  accuracy  and  revisit 
rate)  form  the  constraints  of  the  performance  assessment. 
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bdd  [Package]  Structure  [Disaggregated  Space  System  Logical  Decomposition] 
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Figure  19.  Disaggregated  space  system  logical  decomposition  strategies  summary 
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(performance  constraints,  system  types/  quantities, 
system/subsystem  parameters,  orbit  parameters) 


Figure  20.  DISCO  methodology  overview 

The  performance  assessment  models  consist  of  performance  estimating  equations, 
sizing  equations,  and  cost  estimating  equations  applied  to  candidate  architectures. 
Candidate  solutions  (represented  as  individuals  in  the  genetic  algorithm)  are  evaluated 
and  the  estimated  performance  and  cost  of  the  solution  are  returned  to  the  optimization 
routine.  The  dynamics  model  consists  of  a  numeric  simulation  capability  or  analytic 
coverage  estimating  equations  used  to  assess  the  dynamic  performance  of  the  conceptual 
system.  The  dynamics  model  inputs  candidate  solutions  (individuals)  and  returns 
dynamics  related  performance  measures  (e.g.  revisit  rate).  The  optimization  routine 
evaluates  the  fitness  of  each  of  the  candidate  solutions  as  well  as  the  feasibility  (e.g. 
constraint  violations)  of  each  of  the  candidate  solutions.  The  optimization  routine  then 
outputs  the  best  feasible  candidate  architecture  for  further  evaluation. 

The  DISCO  methodology  assumes  that  the  performance  of  disaggregated  space 
architectures  is  dependent  upon  the  type  of  systems,  the  number  of  systems,  the 
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performance  of  each  system,  and  the  orbital  dynamics  of  the  constellation.  The 
optimization  component  outputs  candidate  near-optimal  disaggregated  space  system 
architectures  in  the  fonn  of  a  design  variables  that  represent  the  number  of  systems 
included  in  the  architecture,  the  critical  design  variables  (i.e.  payload  aperture  diameter 
and  sensor  view  angle)  and  the  constellation  orbital  parameters  (i.e.  orbital  altitude). 
These  near-optimal  solutions  are  assessed  and  evaluated.  The  candidate  solutions  and 
corresponding  calculated  functions  (i.e.  satellite  mass,  volume,  and  power)  are  used  to 
update  the  reference  architecture. 

Optimization  formulation 

Previous  DISCO  optimization  mathematical  models  were  structured  to  minimize 
estimated  Life  Cycle  Cost  [52]  [53].  The  previous  formulation  was  expanded  to  enable 
the  minimization  of  Life  Cycle  Cost  Risk  (LCCR)  or  risk  weighted  cost  (LCC  plus 
LCCR).  This  expansion  enables  the  assessment  of  potential  impacts  from  stochastic 
variables  such  as  space  vehicle  and  launch  vehicle  failure  rates.  Consequently  the 
expanded  DISCO  optimization  formulation  is  an  extension  of  the  standard  Mixed 
Variable  Optimization  (MV-OPT)  outlined  in  [64].  The  corresponding  expanded  DISCO 
mathematical  optimization  formulation  is4: 

Minimize 


f(x )  =  Wj LCC  +  o)2LCCR 

Qde p^dev  _j_  ^-.prod^prod  ^ops ^ ops  _j_  ^sust^ sust  _|_  Qjet^ ret 

fi  i  i  i  i  i  i  i  i 

i= 1 
n± 

LCCR  =  ^  CRft\dev  +  CRprodxfrod  +  CR°psx°ps  +  C7?f“stxfust  +  CR\etx\et 

i= 1 


[25] 

[26] 

[27] 


4  Note  that  the  optimization  objective  function  is  a  non-linear  and  discrete  function.  The  estimated  system 
cost  terms  {cfev ,  cpl  od ,  c°ps ,  c*upt ,  c[et )  are  functions  of  the  problem  design  variable  vector  (x)  for  satellite 
system  types.  Additionally,  the  system  number  terms  (xfev,xprod,x°ps,x^upt,x[et)  are  also  functions  of 
the  problem  design  variable  vector  (x)  and  can  only  have  integer  values. 
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subject  to 


hj  =  0,  i  =  1  ..n2, 

0/  <  0,;  =  1  ..n3 

XjfDj,  Di  (/i>  ^[2'  ■■■  ’  d iqi )<  t  1 . . 

xfev£{0,l} 

xiL  <Xi<  xw,  i  =  (nd  +  1). .  (nd  +  nc) 

where 

/is  the  optimization  objective  function 

x  is  the  design  variable  vector 

oo  is  a  weighting  factor 

LCC  is  the  estimated  system  Life  Cycle  Cost 

LCCR  is  the  estimated  system  Life  Cycle  Cost  Risk 

C  is  the  calculated  cost  coefficient  for  system  type  i, 

CR  is  the  calculated  cost  risk  coefficient  for  system  type  i 
xfev  represents  existence  of  system  type  i  in  an  architecture 
xfrod  is  the  number  of  systems  (type  i)  in  the  conceptual  design 
x°ps  is  the  number  of  systems  that  require  operations 
xfustis  the  number  of  sustainment  systems  required 
xfet  is  then  number  of  systems  that  require  retirement 
h  is  an  equality  constraint  equation 
g  is  an  inequality  constraint  equation 
nd  is  the  number  of  discrete  variable  in  the  discrete  set  D 
xiL  represents  the  design  variable  lower  bound 
Xj u  represents  the  design  variable  upper  bound 
nc  is  the  number  of  continuous  design  variables 


This  design  optimization  formulation  above  is  modeled  to  minimize  the  weighted 
objective  function  of  life  cycle  cost  (LCC)  and  life  cycle  cost  risk  (LCCR).  The  term  risk 
weighted  cost  is  established  for  the  value  associated  with  LCC  plus  LCCR  where  oo^  1 
and  o)2— 1-  The  LCC  and  LCCR  functions  are  broken  up  into  the  corresponding  life  cycle 
phases  (development,  production,  operations,  sustainment,  and  retirement).  The  cost 
coefficients  are  based  upon  cost  models  for  the  appropriate  system  type.  These  models 
are  summarized  in  more  detail  in  the  application  section  of  this  paper. 
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Satellite  Reliability 


Satellite/Space  Vehicle  (SV)  reliability  is  modeled  as  cost  risk  and  calculated 
according  to  the  following  equation: 


CRi  —  PsvFi  *  CsVFi 

where 

CRi  is  the  calculated  cost  risk  for  SV  type  i 
PsvFi  is  the  probability  of  failure  for  SV  type  i 
CSVFi  is  the  estimated  cost  impact  of  an  SV  failure 


An  SV  failure,  in  this  context,  is  assumed  to  be  a  catastrophic  satellite  failure  prior  to  the 
end  of  the  SV  design  life.  The  cost  impact  of  an  SV  failure  CSVFi  is  assumed  to  be  the 
production  cost  of  an  on-orbit  or  ground  spare  SV.  Likewise,  the  probability  of  an  SV 
failure  is  estimated  according  to  the  equation: 

PsvF~Fsv(t)  =  1  —  RsviO  [29] 

where 

PsvFi  is  the  probability  of  failure  for  SV  type  i 

Fsv  (t)  is  the  SV  failure  rate  at  on-orbit  time  (t)  in  years  (%) 

RSv(t)  is  the  estimated  reliability  of  a  space  vehicle  (%) 


Satellite  reliability  has  been  estimated  for  catastrophic  failures  based  upon  empirical  data. 
This  reliability  analysis  has  been  developed  for  large  and  small  satellites  [58].  The 


reliability  equations  follow  the  standard  Weibull  equation  format: 


Psv(.t )  =  exp 


[30] 


where 

R(t)  is  the  reliability  estimating  equation 
t  is  the  time  that  the  satellite  is  on-orbit  (years) 
(3  is  the  shape  parameter  (dimensionless) 

6  is  the  scale  parameter  (years) 
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This  reliability  equation  is  used  to  estimate  the  failure  rate  for  the  corresponding  space 
vehicle  types  identified  in  the  DISCO  problem  formulation. 

Launch  Vehicle  Reliability 

Launch  Vehicle  (LV)  reliability  is  modeled  as  cost  risk  and  calculated  according  to  the 
following  equation: 


LRj  —  Plvfi  *  Clvfi  [31] 

where 

CRi  is  the  calculated  cost  risk  for  launch  vehicle  type  i 
PLvFi  is  the  probability  of  failure  for  launch  vehicle  type  i 
C 'ivFi  is  the  estimated  cost  impact  of  a  launch  vehicle  failure 


The  estimated  cost  impact  of  a  launch  vehicle  failure  includes  the  estimated  production 
cost  of  the  launch  vehicle  plus  the  cost  of  the  satellites  on  the  failed  launch  vehicle.  The 
probability  of  a  launch  vehicle  failure  is  estimated  according  to  the  equation: 

Plvf~Flv(F)  —  1  —  Rlv(X) 

where 

PLvFi  is  the  probability  of  failure  for  launch  vehicle  type  i 
Flv  (t)  is  the  LV  failure  rate  for  launch  attempt  (t)  (%) 

RLV{t)  is  the  estimated  reliability  of  a  launch  vehicle 


Launch  vehicle  reliability  is  estimated  based  upon  Bayesian  estimation  techniques  using 
the  following  equation  from  [60]: 


Plv(P) 


k  +  1 
n  +  2 


[33] 


where 

R(t)  is  the  estimated  reliability  of  the  launch  vehicle 
k  is  the  number  of  successful  launch  events 
n  is  the  number  of  launch  trials 
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These  reliability  modeling  techniques  are  used  to  demonstrate  how  risk  modeling  can  be 
incorporated  into  a  concept  architecture  optimization  application  in  the  subsequent 
application  section  of  this  article. 

Monte  Carlo  Analysis  Methods 

Traditional  steps  in  a  Monte  Carlo  Procedure  include  the  following:  formalize  the 
system  logic,  determine  the  probability  distribution,  develop  the  cumulative  probability 
distribution,  and  perform  the  Monte  Carlo  process  [61].  The  DISCO  methodology 
employs  these  four  steps  to  assess  how  stochastic  parameter  distributions  affect  the 
minimum  risk  weighted  cost  (LCC  plus  LCCR)  solutions.  First,  the  system  logic  is 
defined  via  the  DISCO  approach  and  mathematical  optimization  fonnulation.  Secondly, 
the  probability  distributions  of  the  stochastic  variables  are  identified  using  empirical  data. 
For  example,  the  LV  and  SV  failure  rate  data  are  ascertained  from  the  empirical  launch 
and  on-orbit  failure  rates.  Third,  the  cumulative  probability  distribution  is  developed  for 
the  output.  For  example,  the  cumulative  weighted  LCC  plus  LCCR  distribution  is 
calculated  in  the  example  below.  This  enables  a  system  architect  or  program  decision 
maker  to  understand  the  likelihood  of  program  cost  and  cost  risk  values  based  upon  the 
empirical  reliability  distribution  of  the  various  system  types.  Finally  the  Monte  Carlo 
process  is  executed  via  the  optimization  summarized  in  Figure  2 1 .  The  inner  loop  of  this 
process  is  a  traditional  genetic  algorithm  optimization  loop.  Additional  iterations  of  this 
inner  optimization  loop  are  performed  to  gain  confidence  in  the  identified  solution.  This 
is  necessary  due  to  the  stochastic  nature  of  a  heuristic  genetic  algorithm  (not  provably 
convergent).  The  middle  loop  is  used  to  perfonn  the  Monte  Carlo  analysis  for  a  specific 
case.  The  middle  loop  pulls  random  variables  from  the  previously  identified  probability 
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distributions  and  re-executes  the  optimization  loop  while  recording  each  candidate 
solution.  Finally,  an  outer  loop  enables  one  to  perfonn  a  Monte  Carlo  Analysis  for 
varying  cases  (i.e.  varying  system  requirement  cases). 


Figure  21.  DISCO  optimization  process  overview 


Application 

The  aforementioned  stochastic  parameter  methods  were  applied  to  a  reference 
Weather  Satellite  Follow-on  (WSF)  problem.  Defense  weather  satellites  provide 
environmental  data  used  for  planning  and  conducting  military  operations  worldwide  [2]. 
Defense  Meteorological  Satellite  Program  (DMSP)  satellites  have  been  providing 
weather  data  to  the  defense  community  since  the  1960’s.  In  1995,  a  joint  program 
dubbed  National  Polar-Orbiting  Operational  Environmental  Satellite  System  (NPOESS) 
was  established  with  the  intent  of  consolidating  the  DoD  and  NOAA  weather  satellite 
programs.  The  NPOESS  program  was  cancelled  in  2010  due  technical  and  programmatic 
difficulties  including  significant  cost  growth  and  schedule  delays.  In  response  NOAA, 
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partnering  with  NASA,  established  the  Joint  Polar  Satellite  System  (JPSS)  and  the 
Department  of  Defense  established  the  Defense  Weather  Satellite  System  (DWSS).  The 
DWSS  concept  consisted  of  a  large  multi-function  satellite  with  a  Visible  Infrared 
Imaging  Radiometer  Suite  (VIIRS)  imaging  payload,  a  Microwave  Imager  Sounder 
(MIS)  payload,  and  a  Space  Environmental  Monitoring-NPOESS  (SEM-N)  payload. 
These  three  payloads  were  all  heritage  NPOESS  payload  designs.  The  U.S.  Congress 
instructed  the  DoD  to  terminate  the  DWSS  program  in  2012.  The  DoD  has  since 
launched  its  next  to  last  DMSP  satellite  and  is  assessing  options  for  developing  the  next- 
generation  Weather  System  Follow-on  (WSF)  [3], 

The  WSF  program  is  currently  planned  to  be  developed  as  a  pathfinder 
disaggregated  system.  According  to  US  Air  Force  budget  documents  “WSF  will  take  a 
disaggregated  system-of-systems  approach  to  meet  specific  Department  of  Defense  needs 
while  leveraging  near-term  civilian  and  international  partnerships”  [4].  Initial  WSF 
architecture  and  technology  risk-reduction  studies  are  underway.  These  studies  are 
assessing  visible  and  infrared  sensor  designs,  microwave  radiometer  designs,  spacecraft 
bus  designs,  and  architecture  alternatives  [5].  This  paper  will  apply  the  Disaggregated 
Integral  System  Concept  Optimization  (DISCO)  methodology  to  the  WSF  conceptual 
architecture  problem.  The  applicability  of  the  DISCO  methodology  to  this  multi-function 
multi-orbit  disaggregation  problem  was  previously  addressed  in  [53].  This  previous 
application  is  extended  in  this  article  by  assessing  cost  risk  associated  with  space  vehicle 
and  launch  vehicle  failures. 
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Stakeholder  needs 


Stakeholder  needs  were  derived  from  the  Meteorological  and  Oceanographic 
Collection  (METOC)  Initial  Capabilities  Document  (ICD).  The  METOC  ICD  identified 
the  following  five  space-based  capability  needs 

1.  Weather  Imagery 

2.  Ocean  Surface  Wind  Vector  (OSWV) 

3.  Sea  Surface  Temperature 

4.  Soil  Moisture 

5.  Space  Environment  Monitoring 

The  WSF  mission  is  assumed  to  last  18  years  from  2020  to  2038  according  to 
information  outlined  in  [33]. 

System  Requirements 

The  WSF  system  requirements  were  derived  by  consolidating  the  mission  needs 
identified  in  the  METOC  ICD  with  the  system  requirements  identified  in  the  National 
Polar-orbiting  Operational  Environmental  Satellite  System  (NPOESS)  Integrated 
Operational  Requirements  Document-II  (IORD-II).  The  consolidated  system 
requirements  are  summarized  in  Table  8  as  previously  identified  in  [53]. 
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Table  8.  WSF  system  requirements  summary 


Coverage 

area 

Resolution 

Refresh 

Timeliness 

Accuracy 

(mapping) 

Accuracy 

(measurement) 

Imagery 

Weather  imagery 

global 

.4  km  (nadir) 

.8  km  (edge) 

4hours(avg  revisit)* 

6  hours  (max  revisit) 

90  mins 

1km  (nadir) 

3  km  (edge) 

SNR  119  (L=22)  (.64±  .05pm) 

NEDT 2.5  (T=270K)  (3.74±.38pm) 

Sea  Surface 

Wind  speed 
(Gear) 

global 

(ice-free) 

20km  (nadir) 

6  hours 

90  mins 

5km 

2  m/sec  or  10%* 

NEDT  .7  (305K)  (19.3±.4GHz) 

Wind  direction 
(Gear) 

global 

(ice-free) 

20km  (nadir) 

6  hours 

90  mins 

5km 

20  degrees  (>5m/s) 

NEDT  .7  (305K)  (19.3±.4  GHz) 

Temperature 

(clear) 

global 

1  km  (nadir)* 

1.3  km  (edge) 

6  hours 

90  mins 

1  km  (nadir) 

1.3  km  (edge) 

uncertainty  .5  degrees  C* 
NEDT=.396  (T=270K)  (3.7±.18pm) 

Temperature 
(all  weather) 

global 

40  km  (edge) 

6  hours 

90  mins 

5  km 

NEDT=.7  (305K)  (19.3±.4  GHz) 

Soil  Moisture* 

Moisture  content 
(clear) 

global 

1  km  (nadir) 

4  km  (edge) 

8  hours 

90  mins 

1  km 

5  km 

10%  uncertainty  (skin  layer  -.1cm) 
SNR  119  (L=22)  (.64±.05pm) 

Moisture  content 
(cloudy) 

global 

40  km  (nadir) 

50  km  (edge) 

8  hours 

90  mins 

1km 

5  km 

20%  uncertainty  (skin  layer  -.1cm)* 
NEDT  .7  (305K)  (19.3±.4  GHz) 

Space  Environment 

Monitoring 

Ionospheric  density 
&  scintillation 

global 

100  km 

NA 

90  mins 

KPcmJorJOH 

.1  (amplitude)..!  radians  (phase) 

Charged  Particles 

LEO 

Local 

NA 

90  mins 

NA 

15%  (50  KeV  to  4  MeV) 

Electric  field  3  mV  per  meter  (0+/- 150  mYm'1) 


l>tld  |Package|  Operational  Domain  Model  [Operational  Domain  Model |  ^ 


Figure  22.  WSF  Logical  Architecture 
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Logical  Architecture 


The  WSF  logical  architecture  is  summarized  in  Figure  22  and  discussed  in  more 
detail  in  [65].  The  WSF  architecture  is  expected  to  consist  of  an  unknown  number  of 
large  multi-function  spacecraft,  small  functionally-cohesive  (small  imager,  small 
microwave,  small  space  weather)  spacecraft,  the  launch  vehicles  required  to  deploy  these 
satellites,  and  a  ground  system  that  will  operate  the  satellites,  receive  and  process  the 
mission  data,  and  disseminate  the  mission  data.  It  is  assumed  that  the  NOAA  Satellite 
Operations  Center  (SOC)  will  continue  to  operate  the  WSF  satellites  as  they  currently 
operate  the  DMSP  satellites.  It  is  also  assumed  that  the  Air  Force  Weather  Agency 
(AFWA)  and  Fleet  Numerical  Meteorological  and  Oceanography  Center  (FNMOC)  will 
continue  to  process  and  disseminate  weather  data  similar  to  the  current  ground  system 
construct  used  for  DMSP. 

Optimization 

The  optimization  formulation  for  the  WSF  problem  has  been  updated  from  the 
previous  optimization  formulation  summarized  in  [53].  The  full  optimization 
formulation  with  design  variable  bounds  and  constraint  equations  is  provided  in  appendix 
A  of  this  paper.  The  objective  function  formulation  has  been  updated  as  the  weighted 
sum  of  LCC  and  LCCR  as  introduced  in  the  methodology  section  of  this  paper.  The 
objective  function  LCC  component  is  calculated  according  to  the  following  equation  for 
the  18  year  mission  duration5: 


5  Note  that  the  optimization  objective  function  is  a  non-linear  and  discrete  function.  The  estimated  system 
cost  terms  (cfev,cp’od,c°ps,c^upt,c[et)  are  functions  of  the  problem  design  variable  vector  (:*:)• 
Additionally,  the  system  number  terms  (xfev,xpr°  ,x°ps,x*upt,xfet)  are  also  functions  of  the  problem 
design  variable  vector  (x)  and  can  only  have  integer  values.  The  xis  terms  are  system  specific  design 
variables  included  in  the  design  variable  vector  (x). 
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LCC  is  the  total  estimated  WSF  system  life  cycle  cost 
Cbus  is  the  estimated  cost  for  the  SV  bus 
Cpi  is  the  estimated  cost  for  the  SV  payload 

Cia&t  is  the  estimated  cost  for  SV  Integration  Assembly  &  Test  (IA&T) 

CPM  is  the  estimated  cost  for  the  SV  program  level  (i.e.  Program  Management  (PM)  and 
Systems  Engineering  (SE)) 

CAGE  is  the  estimated  cost  for  the  SV  Aerospace  Ground  Equipment  (AGE) 

Csw  is  the  estimated  cost  for  the  SV  software 

C loos  is  the  estimated  cost  for  the  SV  Launch  &  Orbital  Support  (LOOS) 

p  is  the  number  of  satellite  planes  for  /=!  ..4 

s  is  the  number  satellites  per  plane  for  i=\  ..4 

RC  is  the  number  of  satellite  replacement  constellations 

SC  is  the  estimated  storage  cost  (assumed  to  be  200,000  $K  per  SV  type) 

MD  is  the  planned  mission  duration  (18  years) 


[34] 
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DL  is  the  planned  design  life  for  each  satellite  type  (9  years  for  large  satellites  and  6 
years  for  small  satellites  based  upon  current  commercially  available  spacecraft  design 
lives  for  each  category) 


The  large  satellite  development  and  production  cost  coefficients  are  calculated 
using  the  Unmanned  Satellite  Cost  Model  (USCM)  and  NASA  Instrument  Cost  Model 
(NICM)  as  summarized  in  [53].  Likewise  small  satellite  development  and  production 
cost  models  are  estimated  using  the  Small  Satellite  Cost  Model  (SSCM).  The  launch 
vehicle  cost  coefficients  are  based  upon  average  historical  launch  vehicle  costs  for  each 
launch  vehicle  type.  The  USCM,  NICM,  SSCM,  and  launch  vehicle  cost  models  are 
documented  in  chapter  1 1  of  [1].  The  NASA  operations  cost  model  was  introduced  as  an 
improvement  to  the  LCC  equation  detailed  in  [53].  The  cost  models  are  used  “as  is”  and 
not  examined  in  detail.  The  NASA  operations  cost  model  is  detailed  in  [20]  and  is  based 
upon  the  following  CER: 

C°PS  =  .035308  *  (Csvy928  *  T 

where 

Cops  is  the  estimated  yearly  SV  ops  cost  (2010  $K) 

Csv  is  the  SV  cost 
T  is  the  operations  time  (years) 


This  cost  estimating  relationship  equation  is  updated  to  2010  dollars  by  using  a 
3%  rate  of  inflation  to  maintain  consistency  in  cost  estimating  year  values.  The 
operations  cost  model  is  then  adapted  to  the  DISCO  optimization  formulation  model 
using  the  equation 


£,0ps  _ 


(.035308  *{cfy928*DL^ 


(.03*10) 


+  (.035308  *  (C\prod)-928 


>.  (.03*10) 

*  DL)  for  i  =  1.  .4 
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The  DISCO  optimization  model  has  been  appended  to  minimize  estimated  Life  Cycle 
Cost  Risk  (LCCR).  LCCR  is  estimated  according  to  the  following  equation: 


LCCR  =  CRprodx ,  +  CRs,ustx ,  +  CRprodx?  +  CRsust 


x7  +  CRfrodx-,  +  CR?,ustXr,  +  CRp.'odx , 
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LCCr  is  the  estimated  WSF  Life  Cycle  Cost  Risk 

CR1i>r°d  is  the  cost  risk  associated  with  producing  replacement  SVs  and  LVs  that  failed 
for  the  initial  constellation 

CRfust  is  the  cost  risk  associated  with  producing  replacement  SVs  and  LVs  that  failed  for 
the  planned  sustainment  (replenishment)  SV  constellations 
PsvFi  is  the  probability  of  SV  failure  for  i=1..4 
PLVFi  is  the  probability  of  LV  failure  for  i=5..9 

The  cost  risk  associated  with  on-orbit  satellite  failures  is  calculated  based  upon  the  risk  of 
procuring  additional  spacecraft  to  replace  the  spacecraft  that  failed  prior  to  the  end  of 
their  design  life.  This  probability  of  failure  rate  is  calculated  according  to  the  empirical 


Weibull  models  summarized  in  [58].  The  estimated  PSVF  is  calculated  according  to  the 
following  equation. 


PsvF~Fsv(t )  =  1- exp  Qj  ^jfort>  0 

where 

Fsv  is  the  estimated  failure  rate  for  a  satellite  at  t  years 
t  is  the  number  of  years  that  an  SV  is  on  orbit 
0  is  the  scale  parameter  (years) 

B  is  the  shape  parameter  (dimensionless 

The  associated  failure  rates  for  each  WSF  space  vehicle  type  are  then  calculated  as 
exemplified  below: 
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sv, large 
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PsvF2~Psmaii  =  1  -  exp  (-  (893150  6) 

PSVF3~P small  =  1  ~  eXP  (^50^) 

PsvF4~Fsmall  =  1  -  exp  (893150  6) 

The  large  SVs  have  a  slightly  lower  estimated  failure  rate,  however  it  is  not  substantially 
less  than  the  empirically  estimated  failure  rates  for  small  SVs.  This  is  somewhat 
surprising  considering  that  historically  small  satellites  have  single  string  designs  to 
reduce  mass. 


.2519 


=  4.9% 


=  4.9% 


=  4.9% 


The  launch  vehicle  failures  rates  were  then  calculated  according  to  the  Bayesian 
failure  rate  estimation  equation  detailed  in  [60]  and  discussed  in  the  methodology  section 
for  the  potential  WSF  launch  vehicle  types.  As  the  WSF  program  is  a  U.S.  DoD  mission, 
the  launch  vehicles  were  limited  to  current  U.S.  domestic  launch  vehicles  according  to 
the  National  Space  Transportation  Policy.  The  number  of  launch  vehicle  successes  and 
failures  were  detennined  from  the  2013  Space  Launch  Report  [66].  The  launch  vehicle 


reliabilities  were  then  calculated  as  exemplified  below: 


PlvF5~P Pegasus  XL  ~  1 


37  +  1 


1  LVF 6  1  Minotaur  IV 


=  l  -■ 


42  +  2 
4  +  1 


=  13.6% 


rLVF  7  1  Falcon 9 


=  1- 


4  +  2 
2  +  1 


=  17% 


PlVF8  P Atlas  V  —  1 


2  +  2 
41  +  1 


=  25% 


rLVF7  r Delta  IVH 


=  1  -■ 


42  +  2 
6+1 


7  +  2 


=  5% 


=  22% 


These  LV  failure  rates  can  be  viewed  as  conservative  estimates  of  the  current  failure  rates 


given  that  they  were  extrapolated  from  data  through  2013  and  each  of  these  launch 
vehicles  have  had  many  successful  launches  in  2014  and  several  vehicles  such  as  the 
Falcon  9  were  relatively  new  in  2013.  Therefore  it  should  be  expected  that  the  overall 
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reliability  of  these  systems  will  trend  upward  towards  the  90-95%  historical  reliability 
ratings  as  these  launch  vehicles  fulfill  their  planned  manifests. 

Applied  Monte  Carlo  Analysis 

The  four  step  Monte  Carlo  analysis  procedure,  discussed  in  the  methods  section 
of  this  paper,  was  applied  to  the  WSF  conceptual  design  optimization  problem.  First,  the 
system  logic  was  established  by  modeling  the  WSF  problem  according  to  the  DISCO 
optimization  model  where  optimal  solutions  are  defined  as  the  minimum  weighted  cost 
solution  (i.e.  Min  f(x,  p)  =  o^LCC  +  o)2LCCR  where  uq  =  1  and  o)2  =  1).  Secondly, 
the  failure  rate  probability  distributions  were  modeled  for  the  probabilistic  LV  and  SV 
failure  rates.  Launch  vehicle  failure  rate  distributions  were  modeled  according  to  the 
Bayesian  analysis  techniques  summarized  in  [60]  updated  with  empirical  data  from  [66]. 
The  resulting  LV  failure  rate  distributions  for  the  five  possible  launch  vehicles  selected 
for  the  WSF  problem  are  summarized  in  Figure  23. 


122 


Figure  23.  Probability  density  function  for  WSF  associated  launch  vehicle  failures. 


Space  Vehicle  failure  rate  distributions  were  modeled  as  a  normal  distributions 
based  upon  the  techniques  and  empirical  data  summarized  in  [58].  The  resulting 
distribution  for  the  large  and  small  WSF  satellite  types  with  respective  9  and  6  year 
design  lives  are  summarized  in  Figure  24.  Third,  Random  failure  rates  were  sampled 
from  these  distributions  and  input  into  the  optimization  formulation  for  each  Monte  Carlo 
trial.  The  optimization  routine  was  then  executed  with  10  global  optimization  iterations 
and  100  Monte  Carlo  trials.  The  results  from  the  optimization  were  recorded  and  a 
normalized  histogram  is  developed.  The  normalized  histogram  provides  an 
approximation  of  the  resulting  PDF.  A  Gaussian  mixture  distribution  was  fit  to  the 
results  and  the  resulting  mixed  Gaussian  distributions  were  used  to  produce  PDF  and 
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CDF  summaries  for  the  results.  The  resulting  PDF  and  CDF  summaries  for  the  threshold 
WSF  problem  are  shown  in  Figure  25.  Finally,  the  Monte  Carlo  procedure  was  executed 
for  multiple  cases  via  the  outer  sensitivity  analysis  loop  shown  in  Figure  2 1 .  For  each 
case  the  constraints  associated  with  a  system  requirement  was  varied.  The  Key 
Perfonnance  Parameter  requirement  associated  with  all-weather  Microwave  Ocean 
Surface  Wind  Vector  (OSWV)  revisit  rate  was  varied  from  8  hours  (threshold 
requirement  minus  2  hours)  to  1  hour  (objective  requirement).  The  weighted  cost  trade 
study  curve,  PDF,  and  CDF  results  are  assessed  and  summarized  in  the  subsequent  results 
section  of  this  article. 
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LCC  plus  LCCR($M) 


Figure  25.  Estimated  PDF  (left)  and  CDF  (right)  functions  for  WSF  threshold 

requirements  case 


WSF  results  assessment 

The  optimization  routine  was  executed  10  times  for  each  trial  according  to  the 
optimization  process  outlined  in  [53].  The  architecture  solution  was  then  recorded  and  the 
best  solution  for  each  scenario  is  presented  in  the  results  section.  An  initial  analysis  was 
completed  to  determine  whether  a  higher  launch  vehicle  and  space  vehicle  failure  rate 
would  change  the  near-optimal  architectural  solution  identified.  The  impacts  of  various 
satellite  failure  rates  were  assessed  by  significantly  increasing  the  estimated  satellite 
failure  rate.  The  impacts  of  various  launch  vehicle  failure  rates  were  assessed  in  the  same 
manner.  Finally,  a  Monte  Carlo  analysis  was  conducted  and  the  corresponding  outputs 
are  discussing  in  the  subsequent  sections  of  this  paper. 
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Results 


WSF  Results 

The  identified  minimum  cost  solution,  referred  to  as  Disaggregated  Weather 
System  Follow-on  (DWSF),  is  summarized  and  compared  to  the  baseline  Defense 
Weather  Satellite  System  (DWSS)  concept  in  Table  9.  The  DWSS  concept  preceded  the 
WSF  program.  The  DWSS  SV  contained  a  Visible  Infrared  Imager  Radiometer  Suite 
(VIIRS)  payload,  a  Microwave  Imager/Sounder  (MIS)  payload,  and  a  Space  Environment 
Monitor-NPOESS  (SEM-N)  payload  integrated  on  single  large  multi-function  satellite 
bus.  The  DWSS  concept  and  associated  cost  estimate  basis  is  outlined  in  [33]. 


Table  9-  DWSF  minimum  LCC  solution  compared  to  DWSS 
baseline 


DWSS 

DWSF 

#SV  type  1  (large) 

2  (2/1) 

0 

#SV  type  2  (imager) 

0 

2  (2/1) 

#SV  type  3(microwave) 

0 

8  (2/4) 

#SV  type  4  (space  weather) 

0 

4  (4/1) 

#LV  type  5  (Pegasus) 

0 

2 

#LV  type  6  (Minotaur) 

0 

2 

#LV  type  8  (Atlas  V) 

2 

0 

Estimated  LCC 

$8282M 

$2717M 

Estimated  LCCR 

$205M 

$88M 

The  result  of  the  DISCO  method  applied  to  the  WSF  mission  requirements  in  Table  9 
identifies  an  estimated  $5.57  Billion  in  estimated  life  cycle  cost  savings  and  an  estimated 
$5.68  Billion  in  risk  weighted  cost  savings.  This  represents  a  significant  margin  of 
improvement  garnered  through  disaggregation  and  optimization.  Further  analysis  was 
then  conducted  on  variations  to  the  DWSF  solution  derived  from  changes  in  stochastic 
LV  and  SV  reliability  values.  Initial  results  indicate  that  the  minimum  estimated  cost 
(LCC)  solution  is  also  the  minimum  estimated  cost  risk  (LCCR)  solution  for  the 
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empirically  derived  LV  and  SV  failure  rates.  A  summary  of  the  optimization  results 
demonstrating  this  relationship  is  provided  in  Table  10.  The  architecture  for  the  lowest 
estimated  cost  solution  was  also  the  lowest  cost  risk  solution  based  upon  an  equal 
weighting.  The  estimated  LCC  is  $2717M.  The  estimated  life  cycle  cost  risk  associated 
with  this  solution  is  $88M. 


Table  10-  Optimization  results  summary  for  weighted  LCC  and  LCCR  architectures 


Minimize  LCC 
(«i=l)  (io2=0) 

Minimize  LCCR 
(a>i=0)(o>2=l) 

Minimize  LCC+LCCR 
(©1=1)  (©2=1) 

#SV  type  1  (large) 

0 

0 

0 

#SV  type  2  (imager) 

2  (2/1) 

2  (2/1) 

2  (2/1) 

#SV  type  3(microwave) 

8  (2/4) 

8  (2/4) 

8  (2/4) 

#SV  type  4  (space  weather) 

4 

4 

4 

#LV  type  5  (Pegasus) 

2 

2 

2 

#LV  type  6  (Minotaur) 

2 

2 

2 

Estimated  LCC 

$2717M 

$2717M 

$2717M 

Estimated  LCCR 

$88M 

$88M 

$88M 

Weighted  function 

$2717M 

$88M 

$2805M 

The  small  launch  vehicles  (Pegasus  XL  and  Minotaur  IV)  identified  in  the  near  optimal 
solution  are  statistically  less  reliable  than  the  large  launch  vehicles  however  the  reduced 
cost  risk  associated  with  the  less  likely  failure  of  these  launch  vehicles  are  not  large 
enough  to  outweigh  the  increased  cost  of  using  larger  launch  vehicles.  A  simple  analysis 
was  conducted  to  determine  whether  a  significantly  less  reliable  small  launch  vehicle 
would  impact  the  conceptual  architecture  solution.  The  failure  rate  of  the  Pegasus  XL 
was  increased  from  the  empirically  estimated  13.7%  at  even  10%  increments  to  40%,  at 
which  point  the  minimal  cost  risk  and  risk  weighted  cost  solutions  change.  The 
corresponding  results  of  this  analysis  are  summarized  in  Table  11.  The  minimum 
estimated  cost  solution  remains  the  same  as  the  previously  identified  best  solution.  The 
minimum  cost  risk  and  weighted  cost  risk  solutions  allocate  the  small  imager  satellites  to 
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a  Minotaur  IV  launch  vehicle  to  address  the  high  failure  rate  of  the  Pegasus  XL  launch 
vehicle.  All  other  aspects  of  the  architectural  solution  remain  unchanged. 


Table  11.  Optimization  results  summary  for  weighted  LCC  and  LCCR  architectures  based  upon 
empirical  SV  failure  rates  with  adjusted  Pegasus  reliability  (40%) 


Minimize  LCC 
(on=l)  (to2=0) 

Minimize  LCCR 
(ioj=0)  (co2=l) 

Minimize  LCC+LCCR 
(Wi=l)  (co2=l) 

#SV  type  1  (large) 

0 

0 

0 

#SV  type  2  (imager) 

2  (2/1) 

2  (2/1) 

2  (2/1) 

#SV  type  3  (microwave) 

8  (2/4) 

8  (2/4) 

8  (2/4) 

#SV  type  4  (space 
weather) 

4 

4 

4 

#LV  type  5  (Pegasus) 

2 

0 

0 

#LV  type  6  (Minotaur) 

2 

4 

4 

Estimated  LCC 

$2717M 

S2738M 

$2738M 

Estimated  LCCR 

$88M 

$96M 

$96M 

Weighted  function 

$2717M 

$96M 

$2834M 

As  an  aside,  the  availability  of  the  Pegasus  launch  vehicle  for  DoD  missions  is 
uncertain.  The  optimization  routine  was  executed  without  the  Pegasus  as  an  available 
launch  vehicle  type  and  the  results  matched  the  updated  solution  identified  in  columns  2 
and  3  of  Table  11.  Similar  to  the  high  failure  rate  Pegasus  XL  case,  the  architecture 
changed  minimally  by  allocating  the  small  imager  satellites  to  Minotaur  LVs  with  an 
increase  to  LCC  of  approximately  $21M  and  an  increase  to  LCCR  of  approximately 
$8M. 

An  analysis  was  then  conducted  to  determine  the  impact  of  a  significant 
degradation  in  space  vehicle  reliability.  The  small  space  vehicle  failure  rate  was 
increased  from  the  empirically  modeled  5.2%  in  even  10%  increments  until  the  minimum 
risk  solution  changed  at  50%.  The  results  of  this  analysis  are  summarized  in  Table  12. 
Significant  architecture  changes  only  occurred  for  the  minimum  risk  solution.  This 
solution  reduces  the  number  of  small  microwave  satellites  from  8  to  7,  each  SV  placed 
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into  a  separate  orbital  plane  by  a  single  Pegasus  XL  launch  vehicle.  Consequently  the 
cost  risk  associated  with  satellite  failures  is  reduced  according  to  the  reduced  number  and 
estimated  cost  of  microwave  satellites.  However,  this  increases  the  overall  estimated  life 
cycle  cost  of  the  solution  by  increasing  the  number  of  Pegasus  XL  launch  vehicles 
required  to  launch  the  microwave  satellite  constellation.  Consequently,  the  minimum 
balanced  cost  and  cost  risk  solution  is  consistent  with  the  minimum  cost  solution 
identified  previously.  This  result  indicates  that  the  identified  minimum  cost  solution  is 
robust  to  significant  decreases  in  space  vehicle  reliability. 


Table  12.  Optimization  results  summary  for  adjusted  small  SV  failure  rate  (50%) 


Minimize  LCC 
(coi=l)  (co2=0) 

Minimize  LCCR 
(coi=0)  (io2=l) 

Minimize  LCC+LCCR 
(lO!=l)  (io2=l) 

#SV  type  1  (large) 

0 

0 

0 

#SV  type  2  (imager) 

2  (2/1) 

2  (2/1) 

2  (2/1) 

#SV  type  3  (microwave) 

8  (2/4) 

7 (7/1) 

8  (2/4) 

#SV  type  4  (space  weather) 

4 

9 

4 

#LV  type  5  (Pegasus) 

2 

9 

2 

#LV  type  6  (Minotaur) 

2 

0 

2 

Estimated  LCC 

$2717M 

$2961M 

S2717M 

Estimated  LCCR 

$218M 

$203M 

$218M 

Weighted  function 

S2717M 

$203M 

S2936M 

It  is  important  to  note  that  none  of  the  identified  solutions  included  large  multi-function 


satellites.  The  increased  estimated  development,  production,  and  launch  vehicle  costs 
associated  with  large  satellites  results  in  architectures  led  to  significantly  larger  cost  and 
cost  risk  solutions  despite  longer  assumed  design  lives  and  higher  estimated  individual 
satellite  reliability.  This  result  remains  even  after  the  small  space  vehicle  reliabilities 
were  reduced  to  50%  (which  has  less  than  a  5%  likelihood  according  to  the  empirical  SV 
failure  rate  data)  while  the  large  space  vehicle  reliability  was  maintained  at  96.6%. 


The  results  from  this  analysis  can  be  used  to  inform  programmatic  decisions  with 
regards  to  overall  system  reliability.  For  example,  if  a  single  small  microwave  satellite 
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fails  in  the  DWSF  solution  there  is  minimal  capability  loss.  The  capabilities  associated 
with  the  imagery  SV  and  space  weather  SV  are  still  intact  and  the  revisit  rate  for  the 
products  associated  with  the  microwave  SV  are  only  minimally  reduced.  A  single  large 
satellite  loss  would  have  significant  impact,  by  comparison,  on  the  capability  of  the 
system  by  significantly  reducing  the  revisit  time  for  all  mission  data  products. 
Additionally,  the  magnitude  of  cost  risk  can  inform  decisions  regarding  reconstitution 
and  replenishment.  The  life  cycle  cost  risk  associated  with  LV  and  SV  failures  for  the 
DWSS  concept  is  estimated  at  $205M.  The  estimated  production  cost  of  a  DWSS 
satellite  is  $864M.  Consequently,  it  is  difficult  to  justify  the  procurement  of  an  additional 
DWSS  SV  for  rapid  replenishment  of  the  constellation  after  a  failure.  Alternatively,  the 
life  cycle  cost  risk  associated  with  LV  and  SV  failures  for  the  DWSF  solution  is 
estimated  at  $77M.  The  combined  production  costs  for  a  single  small  imager,  small 
microwave,  and  small  space  weather  SV  is  approximately  $72M.  Consequently, 
production  of  ground  or  on-orbit  spares  for  the  DWSF  constellation  is  comparatively  easy 
to  justify. 

WSF  Monte  Carlo  Results 

WSF  Monte  Carlo  analysis  results  are  summarized  in  Figure  26.  All  of  the 
solutions  consist  of  small  imager,  small  microwave,  and  small  SEM  satellites.  All  of  the 
solutions  consist  of  2  small  imager  satellites  deployed  individually  into  2  planes  by  a 
Pegasus  XL  launch  vehicle.  The  number  of  small  microwave  satellites  increases 
exponentially  as  the  Ocean  Surface  Wind  Vector  (OSWV)  revisit  requirement  is 
tightened  from  8  hours  (threshold  requirement  minus  2  hours)  to  the  objective  value  of  1 
hour.  The  number  of  small  SEM  satellites  increase  incrementally  as  the  number  of  small 
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microwave  satellites  increase.  This  incremental  increase  was  expected  as  the  local  space 
weather  requirements  were  modeled  such  that  each  satellite  plane  should  include  a  SEM 
payload  or  small  SEM  satellite. 
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Figure  26.  Monte  Carlo  Analysis  results  summary 


The  estimated  WSF  LCC  values  increase  exponentially  as  the  number  of  small 
microwave  satellites  increase  exponentially.  The  variation  in  risk  weighted  cost  (LCC 
plus  LCCR)  values  also  increases  exponentially  as  the  number  of  microwave  satellites 
increase. 

The  number  and  type  of  launch  vehicles  vary  among  solutions  depending  upon 
the  randomly  selected  launch  vehicle  failure  rate  values.  The  majority  of  solutions,  for 
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the  8  hour  to  2  hour  OSWV  requirement  cases,  consist  of  Minotaur  4  LVs  that  are 
allocated  to  clustered  planes  of  2,  3,  4,  or  5  Microwave  SVs.  Approximately,  70-80 
percent  of  the  solutions  consist  of  Minotaur  IV  launch  vehicles  assigned  to  the  small 
microwave  and  SEM  SVs.  Approximately  20-30  percent  of  the  solutions  consist  of 
Falcon  9  LVs  allocated  to  the  microwave  and  SEM  SVs.  The  min  risk  weighted  cost 
solutions  contain  Falcon  9  LVs  only  when  the  randomly  sampled  Minotaur  IV  failure  rate 
is  significantly  greater  than  the  randomly  sampled  Falcon  9  LV  failure  rate.  The 
corresponding  reduction  in  LCCR  of  the  Falcon  9  solution  must  be  large  enough  to 
outweigh  the  increased  production  cost  of  the  Falcon  9  vs.  the  Minotaur  4.  The  results 
for  the  1  hour  OSWV  revisit  requirement  case  are  substantially  different  than  the  other 
cases.  The  majority  (61%)  of  solutions  for  the  1  hour  case  consist  of  5  planes  of  8 
microwave  satellites  launched  on  5  corresponding  Falcon  9  LVs.  The  remaining  cases 
(39%)  consisted  of  8  planes  of  5  microwave  satellites  launched  on  8  corresponding 
Minotaur  IV  LVs.  This  result  appears  to  be  related  to  a  change  in  constraint  boundaries. 
The  large  number  of  microwave  SVs  required  to  meet  the  1  revisit  requirement  favors  a 
launch  vehicle  with  the  ability  to  launch  larger  clusters  of  satellites.  However,  the  Falcon 
9  LV  has  a  relatively  large  failure  rate  distribution  enabling  multiple  Minotaur  IV  based 
solutions  with  a  higher  estimated  LCC  but  lower  LCC  plus  LCCR  value. 

The  Monte  Carlo  PDF  results  are  summarized  in  Figure  27  for  selected  cases  (6 
hour-threshold,  3  hour,  and  1  hour-objective).  The  general  shape  of  the  5,  4,  and  2  hour 
cases  were  similar  to  the  1  and  3  hour  case  and  were  excluded  for  figure  readability. 

These  PDF  results  indicate  that  the  minimum  risk  weighted  cost  (LCC  plus  LCCR) 
values  for  optimized  solutions  tend  to  be  skewed  right  and  multi-modal.  The  PDF  peaks 
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correlate  with  the  empirically  estimated  min  risk  weighted  cost  solutions.  The  multi¬ 
modal  nature  of  the  PDF  results  appears  to  be  caused  by  the  combination  of  underlying 
distributions  associated  with  the  mixed  launch  vehicle  solution  sets.  For  example,  the 
multi-modal  shape  of  the  output  pdfs  shown  in  Figure  27  appear  to  be  primarily  scaled 
results  of  the  summed  Minotaur  4  and  Falcon  9  launch  vehicle  failure  rate  distributions 
shown  in  Figure  23. 


The  Monte  Carlo  CDF  results  are  summarized  in  Figure  28.  These  CDF  results 
provide  critical  information  for  the  system  architect  or  acquisition  decision  maker.  These 
results  can  be  used  to  associate  program  risk  weighted  cost  with  a  given  confidence  level 
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when  stochastic  LV  and  SV  failure  rates  are  included  in  the  assessment.  For  example, 
the  system  architect  has  80%  confidence  that  overall  cost  for  the  WSF  program 
(threshold  6  hour  OSWV  requirement  case)  will  not  exceed  $2,820M  when  recovery 
costs  associated  for  catastrophic  LV  or  SV  failures  are  accounted  for.  Likewise,  if  a 
WSF  program  constraint  existed  that  stated  the  maximum  life  cycle  cost  should  not 
exceed  $3,000M  then  multiple  solutions  could  be  selected.  With  this  $3,000M  constraint 
one  could  choose  the  conceptual  design  associated  with  a  4  hour  OSWV  revisit 
requirement  with  70%  confidence.  Alternatively,  the  5  hour  and  6  hour  conceptual 
design  solution  would  be  associated  with  an  80%  and  greater  than  95%  confidence 
respectively. 
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Figure  28.  Monte  Carlo  Cumulitive  Density  Function  summary  for  the  WSF  trade  study  cases. 


Summary 

It  has  been  stated  that  space  system  “disaggregation  lowers  the  cost  of  individual 
vehicles  and  the  operational  impact  of  losing  a  vehicle.  This  approach  allows  more 
tailored  mission  assurance  and  smaller  launch  vehicles,  which  reduces  the  cost  of  launch” 
[3].  The  DISCO  methodology  has  been  proposed  as  an  extensible  methodology  to 
quantitatively  assess  whether  disaggregation  lowers  system  life  cycle  costs  (vs.  individual 
vehicle  costs),  reduces  impacts  of  failures,  and  ultimately  enables  more  tailored  mission 
assurance  solutions.  To  this  end,  this  paper  has  introduced  stochastic  (empirical 
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probability  and  Monte  Carlo)  methods  that  enable  the  assessment  of  the  complex  cost  vs. 
risk  design  space.  The  DISCO  methodology  proved  to  be  extensible  to  incorporating 
stochastic  failure  rate  analysis.  Launch  vehicle  and  satellite  failure  rate  impacts  were 
modeled  as  cost  risk.  The  inclusion  of  satellite  cost  risk  only  required  changes  to  the 
objective  function  and  direct  calculation  of  satellite  failure  cost  risk  associated  with  the 
production  of  a  replacement  satellite.  The  optimization  formulation  required  a 
modification  to  assess  risk  associated  with  launch  vehicle  failures  identified  for  each 
satellite  constellation.  Application  analysis  identified  estimated  life  cycle  cost  savings 
upwards  of  five  billion  dollars  when  compared  with  the  alternative  DWSS  concept.  The 
results  of  this  paper  indicates  that  the  optimized  Disaggregated  Weather  System  Follow- 
on  (DWSF)  solution  is  also  the  minimal  cost  risk  solution  when  empirically  derived 
stochastic  space  vehicle  and  launch  vehicle  failure  rates  are  accounted  for  as  cost  risk. 
The  results  of  this  paper  also  indicate  that  disaggregated  satellite  constellations  may  in 
fact  lower  system  life  cycle  costs,  reduce  the  cost  and  operational  impact  of  losing 
vehicles,  and  enable  more  tailored  mission  assurance  and  smaller  less  costly  launch 
vehicles.  Additional  resiliency  advantages  such  as  smaller  operational  impact  of  lost 
vehicles,  placement  of  satellites  in  less  congested  environments,  and  reduced  benefit  vs. 
cost  of  hostile  acts  are  inherent  to  the  identified  disaggregated  solutions  identified  for  the 
WSF  problem.  Further  extensions  to  this  approach  are  planned  such  as  the  inclusion  of 
development  cost  risk  and  improved  ground  system  modeling. 
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V.  Conclusions  and  Recommendations 


This  chapter  summarizes  conclusions  from  the  individual  chapters,  identifying  the 
significance  of  the  individual  contributions  in  context,  identifying  recommended  actions 
derived  from  the  research  process,  and  recommending  future  research. 

Conclusions  of  Research 

Conclusions  related  to  this  research  fall  into  the  following  three  general 
categories;  conclusions  related  to  the  objectives,  answers  to  the  research  questions,  and 
answers  to  the  research  hypotheses.  Overall  it  was  concluded  that  the  DISCO 
methodology  represents  an  evolutionary  improvement  in  disaggregated  space  system 
conceptual  design.  Solving  heterogeneous  space  system  problems  using  a  constrained 
Mixed  Variable  Optimization  formulation  enables  the  automated  generation  and 
evaluation  of  a  vast  number  of  alternative  architecture  concepts  in  a  much  more  efficient 
manner  than  the  current  manual  approaches.  The  integration  of  a  model  based  reference 
architecture  and  the  optimization  formulation  enables  the  efficient  documentation  of 
alternative  concepts  and  trades  associated  with  alternative  concepts.  This  reference 
architecture  forms  a  strong  basis  for  model  refinement  throughout  the  system  life  cycle. 

Four  conclusions  were  ascertained  as  generalized  answers  to  the  research 
questions.  Research  question  #1  was:  How  does  one  model/optimize  disaggregated  space 
system  concepts?  Model  Based  Systems  Engineering  (MBSE)  and  Mixed  Variable 
Optimization  (MV-OPT)  methods  were  identified  as  effective  methods  for 
modeling/optimizing  disaggregated  space  system  concepts.  The  DISCO  methodology 
extended  these  extant  methods  by  introducing  methods  that  model  heterogeneous  system 
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types  as  design  variables  in  the  MV-OPT  construct  and  modeling  system  requirements 
and  model  parameters  as  optimization  constraints.  Research  question  #2  was:  How  does 
one  model/optimize  multi-orbit/multi-function  disaggregated  space  system  concepts? 
Functional/physical  allocation  methods  derived  from  the  Object  Oriented  System 
Engineering  Method  were  identified  as  capable  methods  for  modeling  multi-function 
disaggregated  space  systems.  The  DISCO  methodology  extended  the  OOSEM  process 
by  creating  a  method  for  mapping  these  allocations  to  an  MV-OPT  formulation. 

Research  question  #3  was:  How  does  one  conduct  trades  studies  and  requirements 
sensitivity  analysis  for  disaggregated  space  system  concepts?  Iterative  optimization  and 
sensitivity  analysis  methods  proved  effective  for  identifying  the  impact  of  requirements 
or  parameter  trades  on  concept  life  cycle  cost  and  life  cycle  cost  risk.  Research  question 
#4  was:  How  does  one  assess  the  impact  of  stochastic  variables  on  disaggregated  space 
system  architectures?  Risk  modeling  and  Monte  Carlo  simulations  were  concluded  to  be 
effective  for  detennining  the  impact  of  stochastic  variables  on  optimal  concept  designs. 

Four  general  conclusions  were  ascertained  as  answers  to  the  research  hypotheses 
identified  in  Chapter  I.  First,  it  was  hypothesized  that  heterogeneous  systems  would  be 
identified  as  near  optimal  solutions  for  multi-orbit  disaggregation  problems.  Results 
indicate  that  this  hypothesis  was  incorrect  and  solutions  tend  towards  homogeneous 
satellite  constellations  for  multi-orbit  disaggregation  problems  such  as  the  example  fire 
detection  problem.  Secondly,  it  was  hypothesized  that  heterogeneous  satellite 
constellations  would  be  identified  as  near  optimal  solutions  for  multi-function/multi-orbit 
disaggregation  problems.  Results  indicate  that  this  hypothesis  was  correct  and  these 
heterogeneous  constellations  demonstrate  significant  cost  improvements  for  complex 
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multi-orbit  multi-function  problems  such  as  the  example  defense  weather  system  follow- 
on  concept.  Third,  it  was  hypothesized  that  optimal  disaggregated  systems  would  have 
lower  system  cost  risks  due  to  failure  than  concepts  based  upon  large  aggregate  space 
vehicles.  Results  indicate  that  this  hypothesis  was  correct  for  the  WSF  problem  and  is 
likely  correct  other  multi-orbit  multi-function  disaggregated  space  system  problems. 

Overall  it  was  concluded  that  DISCO  is  an  effective  and  extensible  methodology 
for  optimizing  disaggregated  space  system  architectures.  Research  developing  and 
applying  the  DISCO  methodology  also  led  to  a  number  of  significant  and  original 
contributions. 

Significance  of  Research 

The  significance  of  the  research  is  two-fold.  First  the  research  is  significant  as  it 
represents  an  evolutionary  improvement  in  space  system  conceptual  design  methods. 
Secondly,  this  research  is  significant  as  it  relates  to  the  specific  design  results  ascertained 
through  the  newly  developed  methodology. 

Significant  and  original  methodology  contributions  are  made  related  to 
disaggregated  space  system  modeling,  optimization  formulation,  orbital  perfonnance 
estimation,  requirement  based  optimization  constraint  methods,  and  stochastic 
analysis/risk  optimization.  Methods  for  modeling  the  various  disaggregation  concepts  in 
a  systems  architecture  framework  are  newly-developed  for  this  research.  A 
heterogeneous  system  optimization  formulation  is  original  and  is  significant  as  it  enables 
generation  and  assessment  of  concepts  for  various  disaggregation  strategies.  An  original 
formulation  for  accurately  approximating  the  average  revisit  of  heterogeneous  Walker- 
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delta  constellations  analytically  was  also  developed  in  the  course  of  this  research.  The 
disaggregated  space  system  optimization  formulation  that  correlates  system  requirements 
with  optimization  constraints  is  perhaps  the  most  significant  methodology  improvement. 
A  system  requirement  constrained  optimization  fonnulation  significantly  improves  the 
linkage  between  space  system  optimization  and  the  top-down  requirements  driven 
systems  engineering  process.  This  system  requirement  constrained  optimization 
formulation  also  significantly  improves  the  ability  of  the  architect  to  detennine  the  cost 
and  risk  impacts  associated  with  varying  system  requirements.  The  newly  introduced 
stochastic  analysis  methods  significantly  improve  the  architect’s  ability  to  assess  cost/ 
cost  risk  impacts  in  real-world  scenarios  where  design  parameters,  such  as  the  probability 
of  system  failure,  are  inherently  random. 

The  novel  conceptual  designs  resulting  from  the  application  of  the  newly 
developed  methods  are  also  significant.  Conceptual  design  results  identified  in  Chapters 
II-IV  represent  promising  solutions  to  pressing  needs  (space-based  fire  detection  and 
weather  systems).  These  results  model  significant  cost  and  risk  reduction  opportunities 
for  future  systems.  These  results  also  indicate  that  similar  cost  and  risk  improvements 
are  likely  to  be  identified  by  applying  the  DISCO  methodology  to  other  space  system 
applications  such  as  imagery,  global  navigation,  missile  warning,  missile  defense,  and/or 
space  surveillance. 

Improved  space  system  conceptual  design  methods  and  results  may  also  lead  to 
larger  impacts  related  to  the  overall  system  acquisition  enterprise.  Cost  effectiveness 
gains  related  to  space  systems  would  help  close  budget  gaps  in  a  fiscally  constrained 
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environment.  Alternatively,  cost  savings  could  be  applied  to  other  system  modernization 
efforts  or  the  initiation  of  new  system  developments. 

Recommendations  for  Action 

Recommendations  for  action  resulting  from  this  research  include  integrating  the 
identified  research  methods  into  space  system  engineering  curriculum  and  texts, 
improving  optimization  and  system  architecture  tools,  and  communicating  the  methods 
and  results  to  the  greater  system  acquisition  community. 

It  is  recommended  that  the  systems  engineering  educational  community  consider 
adoption  of  the  summarized  methodology  into  systems  engineering  and  space  system 
educational  frameworks.  Specifically,  AFIT  should  considering  introducing  the  DISCO 
methodology  in  the  Space  Mission  Analysis  and  Systems  Design  course  (ASYS  531), 
System  architecting  (SENG  640),  and  the  Advanced  Topics  in  Systems  Architecture 
(SENG  740)  courses.  Introducing  the  methods  discussed  in  this  research  could  improve 
students’  capability  to  effectively  architect  solutions  complex  system  architecture 
problems.  It  is  also  recommended  to  develop  an  Appendix  to  the  Space  Mission 
Engineering  textbook  [1].  It  is  envisioned  this  appendix  would  apply  the  DISCO 
methodology  to  the  Firesat  example  provided  in  the  text  similar  to  chapter  II.  Inclusion 
of  this  research  would  expand  the  current  space  mission  engineering  body  of  knowledge 
and  expand  current  methods  focused  on  techniques  for  identifying  and  analyzing  point 
design  concepts. 

Two  primary  recommendations  for  future  action  were  identified  related  to 
systems  engineering  tools.  First,  a  genetic  algorithm  optimization  function  should  be 
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developed  that  is  capable  of  constrained  multi-variable  optimization  where  the  constraints 
are  allowed  to  be  non-linear  constraint  functions.  The  sensitivity  analysis  methods 
discussed  in  Chapter  III  and  the  Monte  Carlo  techniques  discussed  in  Chapter  IV 
implemented  iterative  single  objective  optimizations  for  each  requirements  case.  This 
analysis  would  likely  be  significantly  more  computationally  efficient  if  a  multi -objective 
genetic  algorithm  could  be  used.  However,  this  would  require  a  multi-objective  genetic 
algorithm  that  allows  non-linear  constraint  functions  and  none  of  the  publically  available 
genetic  algorithms  surveyed  allow  this.  Secondly,  system  architecture  tool  developers 
should  continue  to  improve  the  integration  between  systems  engineering  descriptive 
models  and  analytical  engineering  analysis  tools.  System  architecture  plug-ins,  such  as 
Paramagic®  and  MBSE  Pak®,  have  greatly  improved  this  integrated  capability. 

However,  it  is  still  difficult  to  develop  and  troubleshoot  integrated  descriptive/analytical 
models.  Improvements  to  the  SysML  specification  or  the  development  of  software 
wizards  that  guide  users  through  the  steps  discussed  in  Appendix  B  would  improve  a 
system  architect  or  modeler’s  capability  to  develop  executable  models  with  concordance. 

It  is  recommended  that  the  results  of  this  research  be  communicated  with  the 
larger  acquisition  community.  Continued  communication  with  the  Weather  System 
Follow  program  office  is  likely  to  aid  the  WSF  system  architecture  development  process. 
A  strategic  overview  of  this  research  should  also  be  developed  for  publication  in  a  forum 
intended  for  presentation  of  innovative  thinking  on  military  doctrine  such  as  the  Air  & 
Space  Power  Journal. 
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Recommendations  for  Future  Research 


Several  recommendations  for  future  research  were  identified  through  the  course 
of  this  research  effort.  Recommendations  for  future  research  relate  to  value  modeling, 
ground  system  and  software  modeling,  hosted  payloads,  expanded  risk  components,  sub¬ 
system  performance  verification,  and  additional  space  system  mission  applications. 

The  inclusion  of  value  modeling  into  the  DISCO  methodology  is  a  promising  area 
for  future  research.  A  proposed  method  for  incorporating  value  modeling  into  the 
DISCO  methodology  is  based  upon  multi-attribute  value  analysis  techniques  described  in 
[40]  as  a  “quantitative  method  for  aggregating  stakeholder’s  preferences  over  conflicting 
objectives  to  find  the  alternative  with  the  highest  value  when  all  objectives  are 
considered.”  It  is  envisioned  that  this  value  model  would  enable  the  selection  of 
alternative  optimal  solutions  identified  through  the  sensitivity  analysis  methods  discussed 
in  chapter  II.  The  proposed  objectives  would  map  to  the  various  components  of  cost, 
perfonnance,  and  risk. 

Another  promising  area  for  future  research  relates  to  expansion  of  the  ground 
system  and  software  models.  It  is  recommended  that  the  ground  system  model  be 
updated  to  enable  the  optimization  of  alternative  ground  system  architectures.  The  ground 
system  model  would  enable  the  system  verification  of  critical  system  requirements  that 
span  the  ground  and  space  system  such  as  data  latency.  A  ground  system  model  is  also 
envisioned  to  enable  the  optimization  of  ground  terminal  type,  number,  and  location. 
Improvements  to  the  software  model  would  likewise  increase  the  fidelity  of  the  overall 
model.  Envisioned  improvements  include  accounting  for  separate  mission  payload 
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software  functionalities  and  the  increasing  complexity  factors  of  integrating  these 
software  functionalities. 

Future  research  expanding  the  DISCO  methodology  to  include  hosted  payload 
disaggregation  is  recommended.  It  is  envisioned  that  hosted  payloads  would  be  included 
in  the  reference  architecture  and  optimization  formulation  as  specialized  system  types. 
The  hosted  payload  parameters  would  be  constrained  by  the  potential  host  spacecraft 
parameters.  For  example  the  Iridium  Next  constellation  has  published  set  mass,  power, 
and  volume  constraints  for  potential  hosted  payloads.  Additionally,  design  variables 
such  as  the  orbital  altitude  would  also  be  fixed  by  the  host  spacecraft  constellation 
design.  The  inclusion  of  hosted  payload  system  types  in  the  DISCO  methodology  may 
enable  more  cost  effective  and  lower  risk  concept  designs. 

Future  research  expanding  the  DISCO  methodology  to  include  Multi-domain 
disaggregation  methods  is  recommended.  The  space  situational  awareness  mission  is  a 
good  example  on  an  application  that  would  benefit  from  the  extension  of  the  DISCO 
methodology  to  multi-domain  disaggregation.  The  space  situational  awareness  mission 
currently  consists  of  radar  and  electro-optical  sensors  in  the  ground  domain  and  electro- 
optical  sensors  in  the  space  domain.  The  DISCO  method  should  be  extended  to  enable 
the  automated  generation,  assessment  and  optimization  of  a  space  situational  awareness 
system  concept  that  contains  the  optimal  configuration  of  space-based  systems  and 
ground-based  systems. 

Future  research  should  be  conducted  on  incorporating  additional  cost  risk 
components  into  the  methodology.  The  Monte  Carlo  risk  analysis  fonnulation  should  be 
improved  by  incorporating  space  vehicle  development  and  production  cost  risk.  Space 
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vehicle  development  and  production  cost  risk  should  be  introduced  as  random  variables 
based  upon  the  cost  component  standard  estimated  error  provided  for  each  of  the  cost 
models  used.  Launch  vehicle  production  cost  risk  should  also  be  included  based  upon 
empirical  data.  Inclusion  of  cost  risk  associated  with  other  potential  causes  for  space 
vehicle  failure  such  as  orbital  debris  would  also  improve  the  fidelity  of  the  model. 

Future  research  should  be  conducted  on  expansion  of  the  modeling  methods  for 
expanded  requirements  trades  and  verification.  Constraints  could  be  included  to  verify 
subsystem  requirements  such  as  estimated  power  collected  is  sufficient  to  meet 
operational  duty  cycle  requirements.  Constraints  could  also  be  incorporated  verifying 
adequate  data  link  and  data  storage  capacity.  Additionally,  the  modeling  methods  could 
be  extended  to  enable  the  simultaneous  variation  of  multiple  constraint  requirements. 
These  extended  methods  would  likely  require  further  research  into  improved 
computational  efficiency  such  as  the  use  of  massively  parallel  computing  platfonns  such 
as  distributed  computing  systems  or  supercomputers. 

Finally,  research  should  be  conducted  applying  the  DISCO  methodology  to  other 
space  system  missions  and  possibly  non-space  missions  such  as  missions  related  to 
remotely  piloted  aircraft.  For  example,  the  application  of  the  DISCO  methodology  to  the 
missile  warning,  missile  defense,  military  communications,  and  space  situational 
awareness  (described  above)  mission  are  likely  to  identify  cost  effective  concept  designs 
enabling  significant  savings  across  the  AFSPC  space  system  acquisition  portfolio. 
Likewise,  the  DISCO  methodology  could  be  used  to  identify  cost  effective  heterogeneous 
remotely  piloted  aircraft  swann  concepts  for  ISR  missions. 
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Summary 

A  vision  for  a  new  space  system  acquisition  strategy  was  summarized  in  [3]  that 
presents  disaggregation  as  an  approach  “to  implement  smaller,  less-complex  satellites 
and  distributed  capabilities”  that  encourages  “the  lower-cost  medium-launch  market  and 
allows  disaggregation  of  mission  capabilities,  which  supports  mixed  constellation  of 
small  distributed  capabilities  complemented  by  more  robust  systems”  The  research 
presented  identified  a  methodology  that  enables  the  optimization  of  disaggregated  space 
systems  and  indicates  that  disaggregated  space  systems  are  likely  less  costly  across  the 
system  lifecycle  with  reduced  overall  risk  due  to  catastrophic  system  failures.  This  result 
has  significant  implications  related  to  the  reduction  of  space  system  life  cycle  costs, 
increased  space  system  resiliency,  reduced  development  and  production  timelines, 
improved  space  systems  engineering  education  and  knowledge  base,  a  stabilized 
industrial  base,  and  improved  resource  allocation  capability.  The  disaggregation  strategy 
and  the  DISCO  methodology  are  promising  areas  for  future  research  and  have  the 
potential  to  be  a  positive  disruptive  force  in  the  space  systems  enterprise. 
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Appendix  A  -  Expanded  Space  Systems  Optimization  Literature  Review 

Research  into  disaggregated  space  system  optimization  is  currently  in  its  infancy. 
On-going  research  into  disaggregated  space  system  conceptual  architectures  is  split-up 
between  two  active  research  areas.  Disaggregation  of  existing  space  system  architectures 
is  the  first  area  of  active  associated  research.  General  optimization  of  space  systems 
designs  is  the  second  area  of  active  research.  In  general  disaggregation  research  has  been 
subjective  and  at  a  top  level  and  space  system  design  optimization  has  been  focused  on 
subsystems,  orbits,  or  subsections  of  the  disaggregated  space  system  conceptual  design 
problem. 

Current  research  into  the  active  disaggregation  of  space  systems  is  largely  limited 
to  qualitative  assessments  of  possible  benefits  and  a  few  pathfinder  applications  of 
disaggregation  strategies.  Some  initial  qualitative  research  into  the  impacts  of 
disaggregation  has  been  completed  by  the  US  Air  Force  Space  Command  (AFSPC)  and 
its  acquisition  organization  the  Space  and  Missiles  Systems  Center  (SMC).  AFSPC  has 
completed  a  white  paper  summarizing  the  expected  qualitative  impacts  of  the 
disaggregation  strategy  [36].  AFSPC  is  also  completing  a  series  of  top  level  studies 
evaluating  the  disaggregation  of  space  systems  associated  with  the  current  primary 
AFSPC  mission  areas.  SMC  executives  have  also  completed  a  qualitative  assessment  of 
benefits  associated  with  disaggregating  the  current  primary  SMC  mission  areas 
(Pawlikowski,  Loverro,  &  Cristler,  2012).  There  are  also  a  few  examples  of 
disaggregated  space  system  programs  associated  with  the  various  disaggregation 
strategies.  The  current  analysis  regarding  disaggregation  is  limited  by  the  qualitative 
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nature  of  the  research.  Assertions  are  made  to  the  benefits  and  potential  drawbacks 
without  numeric  or  empirical  verification. 

There  are  significantly  more  examples  of  space  system  optimization.  Current  research 
related  to  space  system  optimization  can  be  split  into  applications  based  upon  the  system 
focus  and  the  dynamic  state  of  the  systems.  The  primary  limitation  of  space  system 
optimization  research  to  date  is  the  inability  to  assess  multi-system  (heterogeneous) 
multi-orbit  (spatially-distributed)  problems  that  arise  from  practical  disaggregated  space- 
system  architecture  problems. 

Previous  Space  system  optimization  research 

Cyrus  D.  Jilla  provided  a  thorough  literature  review  of  Multi-disciplinary  Design 
Optimization  (MDO)  techniques  applied  to  the  space  system  optimization  in  his  Ph.D. 
thesis  titled  A  Multi  objective.  Multidisciplinary  Design  Optimization  Methodology  for 
the  Conceptual  Design  of  Distributed  Satellite  Systems.  According  to  Jilla  “the  first 
formal  applications  of  optimization  within  the  aerospace  field  occurred  within  specific 
specialties”.  The  two-impulse  Hohmann  transfer  ellipse  minimizing  energy  transfer  and 
Walker-Delta  constellations  minimizing  N  satellite  continuous  global  coverage  are  two 
well-known  orbital  dynamics  engineering  specialty  optimization  examples.  Additionally, 
Jilla  claims  that  much  of  the  previous  optimization  in  the  aerospace  field  entails 
“optimizing  individual  components  (e.g.  orbit)  or  subsystems...  and  then  integrating 
these  components  and  subsystems  together”  [55].  This  approach  often  does  not 
necessarily  produce  globally  optimum  or  near  optimum  systems  of  systems.  In 
conducting  a  detailed  literature  review  on  disaggregated  space  system  design 
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optimization  I  have  concluded  that  there  has  been  minimal  change  in  the  research 
environment  associated  with  disaggregated  space  system  conceptual  design  optimization. 
In  addition  I  have  identified  that  the  multi-system  (heterogeneous)  spatially  distributed 
(unknown  orbit)  is  lacking  academic  research.  This  optimization  design  space  is  also  the 
most  applicable  to  real-world  disaggregation  problems.  This  literature  review  analysis 
is  summarized  in  Figure  29  and  the  justification  for  this  figure  is  detailed  in  the  following 
prospectus  sub-sections.  The  intent  of  the  following  paragraphs  is  to  justify  the  claim 
that  research  conducted  into  the  optimization  of  heterogeneous  space  systems  in 
unknown  locations  is  worthwhile  AFIT  doctoral  research. 


Single  System 
Homogeneous  Systems 

Heterogeneous  Systems  (SoS) 


Spatial  Design  Space 


Figure  29  -  Summary  of  academic  research  associated  with  system  design  optimization 


Single  System/Specified  Location 


Todd  Mosher  was  one  of  the  pioneers  in  space  systems  optimization  for  a  single 
satellite  in  an  assumed  orbit.  His  1998  IEEE  aerospace  conference  paper  titled 
Spacecraft  Design  Using  a  Genetic  Algorithm  Approach  outlined  a  method  for  modeling 
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a  spacecraft  as  a  mixed  integer  problem  fonnulated  to  minimize  cost  under  performance 
constraints.  Using  genetic  algorithm  optimization  methods  he  demonstrated  the  utility  of 
the  approach  on  the  conceptual  design  of  the  Near  Earth  Asteroid  Rendezvous  (NEAR). 
He  expanded  his  method  and  applied  it  to  the  Mars  Global  Surveyor  and  an  original 
Eagle-eye  commercial  lunar  mission  in  his  Ph.D.  dissertation  entitled  Improving 
Spacecraft  Design  Using  a  Multidisciplinary  Optimization  Methodology.  Mosher 
continued  on  to  develop  tools  for  the  optimization  of  space-system  component  selection. 
Numerous  articles  followed  Mosher’s  work  on  the  optimization  of  spacecraft  systems  or 
components  in  a  prc-defincd  or  known  orbit.  A  significant  amount  of  research  in  this 
area  use  genetic  algorithms  or  other  metaheuristics  to  assess  combinatorial  non-linear 
optimization  problems.  Rania  Hassan  et  al.  compare  the  perfonnance  of  a  Particle  Swarm 
Optimization  (PSO)  algorithm  and  a  Genetic  Algorithm  (GA)  applied  to  a  geostationary 
communication  satellite  design  problem  in  their  article  titled  A  Comparison  of  Particle 
Swann  Optimization  and  the  Genetic  Algorithm  [671.  Sherman  used  a  genetic  algorithm 
to  optimize  the  design  of  the  phased  array  antenna  shape  and  antenna  patterns  as 
discussed  in  article  titled  Phased  array  shaped  multi-beam  optimization  for  LEO  satellite 
constellations  [68].  These  are  just  a  few  examples  of  the  multitude  of  articles  on  space 
system  or  space  system  component  optimization  for  a  single  system  in  a  specified 
location.  Fasano  and  Pinter’s  book  titled  Modeling  and  optimization  in  space 
engineering  also  contain  examples  for  global  optimization  of  sensor  placement  and 
subsystem  placement  for  single  satellite  designs  [69],  This  research  is  fundamental  to  the 
DS30  methodology  as  it  demonstrates  space  system  parameters  can  be  optimized  for  cost 
and  performance  effectiveness  using  metaheuristic  optimization  techniques. 
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Homogeneous  Systems/Specified  System  Locations 


Generally,  there  was  significantly  less  academic  research  in  the  arena  of 
homogeneous  space  systems  with  specified  system  location  than  I  first  assessed.  A 
significant  amount  of  research  that  attempted  to  optimize  parameters  associated  with 
constellations  of  homogeneous  satellites  also  addressed  the  parameterization  of  a  minimal 
subset  of  orbital  parameter  such  as  circular  orbit  altitude.  A  few  academic  research 
articles  were  identified  that  optimized  the  payload  configurations  of  geosynchronous 
communication  satellites  in  assumed  geostationary  locations.  .  For  example,  Rita 
Rinaldo  and  Riccardo  De  Gaudenzi  addressed  the  optimization  of  forward  and  return 
links  for  multi-beam  satellite  broadband  systems  [70].  Additionally  McCormick  et.  al. 
investigated  the  optimization  of  a  fractionated  NPOESS  satellite  constellation  in  their 
AIAA  space  conference  paper  titled  Analyzing  Fractionated  Satellite  Architectures  Using 
RAFTIMATE  [711.  This  paper  used  a  value  analysis  approach  to  optimize  design  and 
test  whether  a  fractionated  National  Polar  Orbiting  Earth  Sensing  System  (NPOESS) 
constellation  provided  more  robust  value  than  a  non-fractionated  design.  There  was 
significantly  more  research  in  the  optimization  of  terrestrial  communication  systems  vs. 
space  systems.  This  is  likely  due  to  the  fixed  location  of  communication  system  vs.  the 
fundamentally  dynamic  nature  of  space  systems.  The  research  in  this  context  has 
minimal  impact  on  the  proposed  research  as  the  DISCO  methodology  fundamentally 
attempts  to  address  the  association  of  space  system  perfonnance  and  the  orbital  location 
and  the  corresponding  impact  on  space  system  cost. 
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Heterogeneous  Systems  of  Systems/Specified  Locations 


There  is  some  significant  research  in  the  context  of  heterogeneous  space  systems 
in  specified  locations.  Mark  G.  Matossian  is  often  cited  as  a  pioneer  in  heterogeneous 
space  system  optimization.  His  article  titled  Earth  Observing  System  Constellation 
Design  Optimization  through  Mixed  Integer  Programming  was  one  of  the  first  space 
system  optimization  efforts  that  transitioned  from  assuming  identical  spacecraft  and 
optimizing  coverage  to  optimizing  spacecraft  configurations  with  varied  payloads. 
Matossian  used  a  branch  and  bound  algorithm  with  linear  equations  representing  the 
combination  of  pre-existing  payloads  that  are  clustered  on  spacecraft  and  launch  vehicles 
for  optimal  cost  vs  weighted  mean  science  performance.  An  example  of  the  output  of  his 
optimization  method  and  corresponding  sensitivity  analysis  is  shown  in  Figure  30.  His 
optimization  approach  was  used  to  make  the  claim  that  the  on-going  rebaseline  of  EOS 
instruments  was  non-optimal.  This  approach  varies  significantly  from  the  DISCO 
methodology  in  its  use  of  pre-defined  sensors,  linear  assumptions,  subjective  instrument 
performance  matrices,  and  the  use  of  pre-defined  orbits  [37]. 
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The  Efficient  Frontier 
Sensitivity  of  Instrument  Candidate  Pool 


Weighted  Mean  Science  Performance  Penalty 


Figure  6. 1  Without  a  systems-oriented  optimization  tool,  it  is  difficult  to  know 
which  instruments  to  eliminate  during  the  original  selection  process  or  during 
downsizing  exercises.  While  the  model  does  not  capture  all  the  many  factors 
taken  into  consideration  in  instrument  selection,  die  closest  analog  to  the 
"Rebaseling"  re-design  process  would  consider  only  the  surviving  EOS 
instruments  as  candidates  and  force  the  use  of  the  AM-1  spacecraft  in  the  final 
configuration.  NASA's  actual  Rebaselined  EOS  configuration  is  included 
above,  and  does  not  compare  favorably  with  the  efficient  frontier  graph  for  the 

onalnn 

Figure  30  -  Example  cost  vs.  weighted  mean  science  return  output  [37] 


Daniel  Selva,  Bruce  G.  Cameron,  and  Edward  F.  Crawley  have  recently  extended 
Matossian’s  approach  to  optimization  of  the  EOS  constellation  using  population-based 
heuristics  with  expert  opinion  derived  rules  to  optimize  clusters  of  previously  existing 
EOS  sensors  on  notional  spacecraft  and  launch  vehicles.  In  their  Earth  Sciences  Decadal 
survey  report  titled  Rule-Based  System  Architecting  of  Earth  Observing  Systems:  The 
Earth  Science  Decadal  Survey  they  applied  genetic  algorithms  to  the  packaging  of  EOS 
sensors  without  the  linear  assumption  used  be  Matossian  and  with  expanded  qualitative 
rules  based  upon  expert  assessment  of  scientific  payoff  of  varying  payloads  [72].  In 
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Selva  and  Crawley’s  paper  Integrated  Assessment  of  Packaging  Architectures  in  Earth 
Observing  Programs  they  include  qualitative  analysis  of  lifecycle  cost,  and  programmatic 
risk  based  upon  fuzzy  rules  derived  from  qualitative  analysis.  Selva  also  recently 
perfonned  a  preliminary  assessment  of  perfonnance  and  cost  of  a  cubesat  component  of 
the  earth  science  decadal  survey  [73].  The  Selva  et  al.  research  differs  from  the  proposed 
DISCO  methodology  because  it  clusters  pre-existing  sensors  vs.  parameterization  of 
sensors  and  orbits.  The  work  also  assumes  a  few  orbital  locations  based  upon  the  current 
orbits  of  existing  sensors  rather  than  the  global  optimization  of  orbital  parameter. 
Although  this  work  does  not  address  the  optimization  of  system  parameters  and  location 
(orbital)  parameters  it  does  provide  valuable  background  on  effective  fonnulations  for 
heterogeneous  satellites  with  mixed  sensors.  Additionally,  this  research  also  provides 
some  indications  of  effective  ways  to  address  lifecycle  cost  risk  and  programmatic  risk 
[72]. 

Overall,  there  is  a  significantly  smaller  amount  of  previous  academic  research  into 
optimization  of  heterogeneous  space  systems  than  optimization  of  satellite  or  satellite 
component  design. 

Single  System/Unknown  Location 

A  significantly  larger  body  of  research  is  applied  to  the  optimization  of  orbital 
parameters  based  upon  assumed  satellite  systems.  Kim  et  al.  use  a  genetic  algorithm  to 
optimize  the  local  coverage  problem  of  imagery  satellites  in  their  paper  titled  A 
computational  approach  to  reduce  the  revisit  time  using  a  Genetic  Algorithm  [74] .  The 
Fasano  et.  al  text  Modeling  and  optimization  in  space  engineering  contains  numerous 
additional  research  articles  analyzing  global  optimization  applied  to  single  spacecraft 
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orbits  and  transfers.  The  Fasano  et  al.  text  addresses  global  optimization  approaches  for 
optimal  trajectory  planning,  indirect  methods  form  the  optimization  of  spacecraft 
trajectories,  trajectory  optimization  for  launchers  and  re-entry  vehicles,  global 
optimization  of  interplanetary  transfers,  and  optimization  of  low  energy  transfers  [69]. 
AFIT  has  also  contributed  significant  research  to  the  single  system  unknown  location 
optimization  problem.  One  notable  example  is  the  AFIT  thesis  titled  THE  UTILITY 
AND  LOGISTICS  IMPACT  OF  SMALL-SATELLITE  CONSTELLATIONS  IN 
MATCHED  INCLINATION  ORBITS.  Emery  et  al.  researched  the  optimal  placement 
(RAAN  placement  only)  of  a  tactical  spacecraft  and  ground  tenninal  to  optimize  the 
number  of  available  imagery  download  opportunities  [75].  This  could  be  categorized  as 
heterogeneous  system  as  the  optimization  included  a  satellite  and  ground  terminal 
however  the  location  of  the  ground  terminal  was  selected  at  identified  locations  and  was 
not  part  of  the  optimization  routine.  This  report  was  extended  to  homogeneous  satellite 
constellation  of  up  to  five  satellites  but  the  number  of  satellites  was  likewise  not  included 
in  the  optimization  routine. 

Homogeneous  Systems/Unknown  System  Locations 

Significantly  more  research  has  been  conducted  in  the  arena  of  homogeneous 
systems  with  unknown  system  location  than  previously  assessed.  Irene  A.  Budianto  and 
John  R.  Olds  used  a  genetic  algorithm  approach  to  optimize  alternative  Space  Based 
Infrared  System  (SBIRS)  low  satellite  constellations  in  their  paper  titled  A  Collaborative 
Optimization  Approach  to  Design  and  Deployment  of  a  Space  Based  Infrared  System 
Constellation.  The  investigated  varying  satellite  altitude,  inclination,  and  sensor  view 
angles  to  minimize  system  cost  then  assigned  an  optimum  launch  vehicle  to  the  chosen 
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constellation  as  a  sub-problem  [76].  Sorenson  et  al.  analyzed  the  optimal  orbital 
placement  of  an  ocean  temperature  small  satellite  constellation  in  their  article  titled 
Mission  Design  and  Operations  of  a  Constellation  of  Small  Satellites  [771 . 

There  was  also  a  significant  amount  of  research  applying  multi-objective  optimization  to 
detennine  effective  orbits  for  homogeneous  satellite  constellations.  William  J.  Mason 
conducted  fundamental  research  in  this  area  that  is  summarized  in  his  doctoral 
dissertation  and  corresponding  articles  titled  Optimal  Earth  Orbiting  Satellite 
Constellations  via  a  Pareto  Genetic  Algorithm.  In  this  research  Mason  investigated  the 
optimization  of  inclined  geosynchronous  satellite  orbits  [78].  Matthew  P.  Ferringer 
extended  Mason’s  research  to  other  orbit  types  and  investigated  parallel  processing 
efficiencies.  Ferringer,  and  David  Spencer  analyzed  the  optimization  of  earth  observing 
system  ground  sample  distances  vs.  mean  revisit  time  for  varied  orbital  parameter  in  their 
article  titled  Satellite  Constellation  Design  Tradeoffs  Using  Multiple-Objective 
Evolutionary  Computation  [79] .  Ferringer,  Clifton,  and  Thompson  then  analyzed  the 
efficiencies  of  different  parallel  processing  schemes  to  constellation  orbit  optimization  in 
their  article  titled  Efficient  and  Accurate  Evolutionary  Multi-Objective  Optimization 
Paradigms  for  Satellite  Constellation  Design  [80] . 

The  most  comprehensive  research  into  the  optimization  of  homogeneous  satellite 
constellations  and  unknown  orbital  locations  was  Cyrus  D.  Jilla’s  dissertation  titled  A 
Multi-objective,  Multidisciplinary  Design  Optimization  Methodology  for  the  Conceptual 
Design  of  Distributed  Satellite  Systems.  Jilla  analyzed  a  small  set  of  Walker  orbit 
constellation  variations  with  discrete  payload  parameters  for  a  constellation  design  of 
radar,  planet  finding,  and  broadband  communication  satellites  [55]. 
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Overall  there  was  a  significantly  larger  effort  into  the  optimization  of 
homogeneous  space  systems  with  unknown  system  locations  than  previously  assessed. 
The  research  landscape  figure  was  adjusted  accordingly  to  show  a  subjectively  larger 
body  of  research  knowledge  in  this  area.  The  research  in  this  area  differs  from  the  DISCO 
methodology  because  all  of  the  research  assumes  homogeneous  satellite  constellations. 

Heterogeneous  Systems/Unknown  System  Locations 
I  was  unable  to  identify  any  previous  research  where  optimization  techniques  are 
used  to  identify  heterogeneous  satellite  parameters  and  system  location  (orbit) 
parameters. 

Single  System/Variable  System  Location 

The  optimization  research  in  the  area  of  single  systems  and  variable  systems  is 
significant  but  largely  is  focused  on  the  minimization  of  fuel  vs.  the  DISCO  methodology 
minimizing  cost  against  perfonnance  constraints.  There  is  a  significant  amount  of 
research  into  solving  orbit  optimal  control  problems.  Some  examples  include  Chistof 
Buskens  and  Helmut  Maurer  SQP-methods  for  solving  optimal  control  problems  with 
control  and  state  constraints:  adjoint  variables,  sensitivity  analysis  and  real-time  control. 
Bradley  J.  Wall  and  Bruce  A.  Conway’s  article  titled  Genetic  algorithms  applied  to  the 
solution  of  hybrid  optimal  control  problems  in  astrodynamics.  The  multitude  of 
minimum  fuel  optimization  problems  have  little  correlation  to  the  DISCO  methodology. 

A  few  research  articles  have  attempted  to  optimize  the  coverage  performance  aspect  of 
the  DISCO  methodology  in  a  variable  system  location.  One  good  example  of  this 
approach  is  Thomas  C.  Co,  Costantinos  Zagaris,  and  Jonathan  T.  Black’s  article  titled 
Responsive  Satellites  Through  Ground  Track  Manipulation  Using  Existing  Technology 
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[81].  In  this  article  the  authors  use  optimal  control  methods  to  investigate  the  possibility 
of  increasing  operational  coverage  responsiveness  by  optimizing  orbit  maneuvers  based 
upon  available  time  and  varied  propulsion  types.  Overall,  the  research  identified  in  this 
area  was  consistent  with  the  original  subjective  assessment  shown  in  the  research 
landscape  summary  figure.  However,  significantly  more  research  could  be  performed  in 
this  area  regarding  the  increase  in  overall  system  capability  and  the  potential  reduction  in 
cost  provided  by  maneuverable  space  systems. 

Homogeneous  Systems/Variable  System  Location 
Some  research  has  been  conducted  into  the  optimization  of  satellite  orbit 
reconfiguration  to  meet  multiple  performance  objectives  while  minimizing  fuel  costs.  A 
good  example  of  this  research  is  Matthew  P.  Ferringer,  David  B  Spencer,  and  Patrick 
Reed’s  article  titled  Many-objective  reconfiguration  of  Operational  Satellite 
Constellations  with  the  Large-Cluster  Epsilon  Non-dominated  Sorting  Genetic 
Algorithm-11  [821  .  In  this  article  the  authors  describe  a  method  to  optimize  maneuvers 
given  the  notional  loss  of  a  GPS  satellite.  The  authors  were  able  to  identify  solutions  that 
balanced  coverage,  signal  strength,  propellant  usage,  and  time  of  flight  using  a  multi¬ 
objective  genetic  algorithm  technique.  They  also  analyzed  the  precursors  to  this  research 
in  their  conference  paper  titled  Pareto  Hypervolumes  for  the  Reconfiguration  of  Satellite 
Constellations  f  831 .  Overall,  an  initial  assessment  of  the  homogeneous  system/variable 
location  system  architecture  was  originally  unknown.  It  appears  that  there  is  a  significant 
amount  of  research  in  this  area  though  less  than  the  single  system/variable  location 
design  space.  This  existing  research  also  varies  significantly  from  the  DISCO 
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methodology  because  it  does  not  address  overall  system  cost  or  performance  and 
typically  focuses  on  the  optimization  of  orbital  transfer  maneuvers. 

Heterogeneous  Systems/Variable  System  Location 
I  was  unable  to  identify  any  academic  publication  regarding  the  optimization  of 
heterogeneous  space  systems  with  variable  system  locations. 
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Appendix  B  -  Additional  Methodology  Development 

Additional  methods  were  developed  during  this  research  related  to  reference  architecture 
development  and  architecture/model  concordance.  The  following  sections  of  this 
appendix  provide  an  example  of  the  methods  used  for  developing  the  WSF  reference 
architecture  and  establishing  concordance  between  this  architecture  and  the  DISCO 
models.  These  methods  were  not  fully  described  in  the  research  manuscripts. 
Consequently,  a  description  of  these  methods  is  included  in  this  appendix. 

A  reference  space  based  weather  domain  architecture  description  was  developed  for 
WSF.  A  summary  of  this  mission  domain  architecture  is  presented  in  Figure  3 1  showing 
the  system,  interfacing  systems,  and  the  relevant  environment. 


Figure  31.  Reference  WSF  mission  domain  architecture 
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A  reference  system  architecture  description  was  then  developed  for  WSF.  An  overview 
of  this  reference  system  architecture  is  displayed  in  Figure  32  displaying  the  logical 
architecture  with  the  potential  system  types  and  their  component  composition. 


Figure  32.  WSF  reference  system  architeture  description 


Applicable  system  requirements  were  then  built  in  requirements  diagrams  associated  with 
the  system  component  of  interest.  These  system  requirements  are  stereotyped  as  property 
based  requirements  allowing  a  linkage  between  the  textual  requirements  and  a 
numerically  calculated  requirement  value.  The  property  based  requirements  are  then 
copied  into  a  block  diagram  linking  the  calculated  value  and  the  property  based 
requirement.  This  linkage  is  established  as  a  satisfy  requirement  relationship  as  shown  in 
Figure  33 
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Ixkl  [P a d< age]  Verification  [  OSVW  refresh  reqt  dieck  jj 


oonslraints 

revisit :  WSF  System  Requirements 


«system» 

Space  System 


parts 

system  1  :  Large  Multi-functionSpace  Vehicle 

system  2 :  Small  Imager  Space  Vehicle 
system  4 :  Small  Space  Environment  Satellite 
system3 :  Small  Microv\ave  Space  Vehide 

values 

Integer 

LMF  SV planes:  Integer  =  0 
LMF  svsats/plane  :  Integer  =  0 

OSWV  refresh :  hr  =  4.9486625{Satisfies=  OSVW  Refresh} 
small  imager  sv  planes :  lnteger=  2 
small  im  ager  sv  satsJfelane :  Integer  =  1 
small  microv\ave  sv  planes :  Integer  =  2 
small  micrcmave  sv  satsJfelane  :  Integer  =  4 


small  microwave  sv  planes :  Integer 


OSWV  refresh :  hi 


small  microwave  sv  sats  plane :  Integer 


«satisfy» 


«requirem  ent» 

«P  roperty6a  sedR  equi  rem  enb 

OSWV  Refresh 


Id  =  "2" 

Text  =  "Ocean Surface  Wind 
Vector  data  refresh  rate 
shall  be  less  than  6  hours 
(21,600  seconds)" 
units  =  "hr 
upperBound  =  6.0 


Figure  33.  Example  satisfy  requirement  relationship 

The  software  performance  and  dynamic  model  functions  are  imported  into  ModelCenter 


®  as  data  analysis  model  components.  The  input  and  output  variables  used  by  the 


architecture  model  are  defined  and  exposed  as  external  variables.  A  SysML  constraint 


block  is  then  created  using  the  MBSE  analyzer  plug-in  and  links  between  the  system 


architecture  reference  model  variables  and  performance/dynamics  model  variables  are 


created  as  shown  if  Figure  34.  The  linkage  between  variables  is  a  key  step  in  the 


concordance  process  between  the  integrated  models. 
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Figure  34.  Overview  of  constraint  block  creation 


A  Parametric  diagram  is  then  created  for  the  system  component  associated  with  the 
requirement  to  be  verified.  For  example  the  OSWV  revisit  is  a  space  system  level 
requirement  and  therefore  a  parametric  diagram  is  created  for  the  space  system  block 
shown  in  Figure  32.  Binding  parameters  are  then  established  linking  the  system  value 
components  with  the  appropriate  input  and  output  parameters  as  shown  in  Figure  35. 


163 


par  [System]  Space  System[  Space  System  Requirements  Verification ]J 


small  microwave  sv  planes :  Integer 


small  microwave  sv  satsplane :  Integer 
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or  liital  altitude :  Km 
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dameter :  m  | 


view  angle :  degrees 


LM=  SV  planes :  Integer 


LW  sv  satsplane  :  Integer 


or  liital  altitude :  Km 


large  imager :  Visible  Inflated  Sensing  Payload 


large  nicrowave  pi :  Mcrowave  Sensing  Payload 


view  angle :  degiees 


Large  SEM  PL:  Space  Environment  Monitoring  Payload 


small  imager  sv  planes :  Integer 


- 


small  imager  sv  sats  plane :  Integer  j — 


system  2  :  Small  Imager  Space  Veiiicle 


or  liital  altitude :  Km 


imager  bus:  Small  Satellite  Bus 


imager  payload  :  Visible  Infrared  Sensing  Payload 


system  4 :  Small  Space  Environment  Satellite 


*104:  Ri 

>304 :  Real 


>306 :  R. 

xIOI :  Real 


«constraint» 

•Eternal  Analysis* 

revisit :  WSF  System  Requirements 


LCC :  Real 

LCCR  :  Real 


OSWV  refresh :  Real 


OSWV  refresh :  l» 


appx  OSVW revisit :  Real 


Figure  35.  OSWV  calculation  parametric  diagram 
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The  model  can  now  be  evaluated  based  upon  the  imported  default  values  from  the 
optimization  model  results.  The  model  is  evaluated  using  the  evaluate  design 
functionality  built  into  the  MBSE  Analyzer®  plug-in.  Design  variables  can  be  adjusted 
and  the  corresponding  simulation  will  re-execute  the  model  components  as  demonstrated 
in  displayed  in  Figure  36.  After  the  model  is  executed  the  resulting  system  parameters 
can  be  saved  as  the  architecture  model  default  values  or  the  updated  architecture  model 
can  be  saved  as  a  design  instantiation.  This  overall  process  enables  the  automated 
update  and  concordance  evaluation  for  iterative  optimization  model  results.  Trades  can 
then  be  made  to  finalize  the  concept  design  chosen  and  the  selected  preferred  architecture 
is  documented  in  the  system  model.  This  system  architecture  model  then  fonns  the  basis 
of  the  system  architectural  description  that  will  be  refined  through  the  system  life  cycle. 


Figure  36.  Executable  architecture  model  evaluation. 
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